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ABSTRACT 

A study analyzed the implementation, impact, and 
cost-effectiveness of an on-the-job training (OJT) program for 
recipients of Aid to Families with Dependent Children (AFDC) in New 
Jersey, operated as part of the state's Work Incentive (WIN) 
Demonstration system. Enrollees in the program, mostly female single 
heads of household, were placed with employers for six months of 
training, with half their wages paid by the state for the trial 
period. They were to be hired after the six months if they worked 
satisfactorily. New Jersey used a process known as welfare grant 
diversion to finance the wage subsidies. An experimental group and a 
group of similar women who did not participate in the program were 
compared. The study found that approximately 200 people were placed 
in jobs, with slightly more than half completing the subsidy period. 
All but one of those completing the subsidized period were retained 
zz unsubsidized employees. The OJT program led to substantial 
employment gains in the first two quarters after random assignment; 
the gains then declined sharply. The OJT program completers earned 22 
percent higher wages than average for the control group. The OJT 
group spent fewer months on AFDC and received $265 less in welfare 
payments in the first year after the experiment. The study concluded 
that the program could be expected to pay for itself within about two 
and one-half years, with savings thereafter, and it benefitted those 
enrolled in it. (KL> 
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PREFACE 



This is the final report on MDRC's evaluation of New Jersey's Grant 
Diversion Project, an or.-che-job training (OJT) program for recipients of 
Aid to Families with Dependent Children (AFDC). Operated as a small-scale, 
voluntary program, it was one of several employment and training services 
available to AFDC recipients through the New Jersey Work Incentive (WIN) 
Demonstration system. 

The New Jersey evaluation, and an earlier study of Maine's Training 
Opportunities in the Private Sector (TOPS) Program, provided an opportunity 
for MDRC to examine the results of a voluntary program as part of its 
multi-state Demonstration of State Work/Welfare Initiatives. The other 
programs evaluated in this multi-year, large-scale series of studies (in 
Arkansas, California, Illinois, Maryland, Virginia, and West Virginia) were 
all .nandatory, generally low- or moderate-cost iniMatives that served a 
broad segment of the WIN caseload. Like other OJT programs, New Jersey's 
initiative was intended to provide welfare recipients with access *:o jobs 
that paid higher wages and offered greater opportunities for stable employ- 
ment and career advancement than jobs they would have normally obtained 
through their own initiative. The New Jarsey evaluation is also of 
interest because, as in Maine, New Jersey paid for OJT wage subsidies 
through an innovative funding process known as grant diversion. Under 
9rant diversion, funds formerly allocated to AFDC grants are used instead 
to subsidize a share of the OJT wages. 

The Demonstration of State Work/Welfare Initiatives is a unique 
opportunity for MDRC to work with states in evaluating their employment 
programs and to examine a subject of national and state concern: the 
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critical relationship between work and welfare dependency. Addressing 
state issues in a manner that benefits policy at many levels is a challenge 
that MDRC is privileged to undertake. 

The demonstration documents a shift in responsibility from the federal 
government to the states. The individual studies evaluate the initiatives 
designed and implemented by the states under the provisions of the Omnibus 
Budget Reconciliatior Act of 1981. This authorized states to operate 
Community Work Experience Programs (CWEP) for AFDC and to streamline the 
administration of the Work Incentive (WIN) systems. Since states responded 
to these options in different ways, the demonstration is not built around a 
single model. Rather, the evaluations c ocus on initiatives that represent 
seme of the major variations being tried in this countiy, * spanning a range 
of local economic conditions and AFDC provisions. 

MDRC could not have conducted this multi-year study without the 
support of The Ford Foundation, which provided funds for planning and for 
the evaluation activities of the participating states, matching an equal 
investment of state or other resources. This joint funding is another 
significant aspect of the demonstration. 

Throughout this demonstration MDRC has been gratified by the 
commitment of the participating states and foundations and their interest 
in the findings. It is our hope that this demonstration and its results 
have contributed to informed decisionmaking and will ultimately lead to 
even more effective programs, which will increase the self-sufficiency of 
welfare recipients. 

Judith M. Gueron 
President 



EXECUTIVE SUMMARY 



This report analyzes the implementation, impact, and cost-effective- 
ness of an on-the-job training (OJT) program for recipients of Aid to 
Families with Dependent Children ( AFDC) in New Jersey. The program was 
operated as a small-scale, voluntary component within the broader range of 
employment and training services offered to welfare recipients through the 
state's Work Incentive (WIN) Demonstration system. Thus, the evaluation 
addresses one program option, not the WIN Demons ttdt ion system as a wliole* 

Enrollees in the program, mostly female single heads of household, 
were eligible for placement in OJT positions with local employers. These 
employers (mainly in the private sector) agreed to hire one or more welfare 
recipients on a trial basis for a specified period of up to six months, 
with the understanding that individuals who performed satisfactorily during 
the trial period would then be retained as regular full-time employees. In 
return, the state reimbursed employers for half the wages paid to OJT 
employees during the trial period. 

New Jersey used a process known as welfare grant diversion to finance 
the wage subsidies offered to OJT employers. The state's reliance on this 
funding mechanism was reflected in the program's official name, the WIN 
Grant Diversion Froject. Nevertheless, the focus of this repoit is on the 
effectiveness of the OJT program rather than the details of the grant 
diversion funding mechanism , which was merely the way the state elected to 
pay for the OJT wage subsidies. 

-Vii- i Q 



Overview of Research Questions and Findings 

This study assesses the effects of adding an OJT component to the 
existing system of employment-relate activities for welfare recipients 
registered with WIN. It does so by comparing the employment, earnings, and 
welfare receipt for two groups who differed only in the program services 
available to them. The first (called the -experimental group' in this 
study) was eligible for OJT positions, as well as the normal array of 
services under the WIN and Job Training Partnership Act (JTPA) rystems. 
The second group (called the 'control group") was also eligible for WIN and 

.TTPA cprvir« f hilt n^i- for tbo WIM n.TT comnrv pn r ; Apnrnyi matoly .13 nprrpnf 

of the experimental actually worked in OJT positions, and many within both 
the experimental and control groups received other WIN or JTPA services. 

About 82 percent of experimentals and 75 percent of controls were 
employed at some point during the first year of follow-up. The higher 
employment rate for experimentals resulted directly from their entering 
subsidized OJT positions. By the second year of follow-up, when almost all 
the experimentals had completed their OJT subsidy period, there was no 
significant remaining difference in the percentage of experimentals and 
controls who were employed, but the experimentais averaged $468 more in 
total earnings — a 15 percent gain. This suggests thai while the program 
did not produce sustained increases in the number of people with jobs, it 
did lead to jobs which either paid higher wages or provided more hours of 
work even after experimentals had completed the OJT subsidy period* The 
earnings gains were accompanied by welfare savings, which peakad during the 
third through sixth quarters f follow-up and averaged $238 (oi 11 percent 
of the control group mean) in the second year. 

r 
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Because the increase in earnings was greater than the reduction in 
welfare payments, the exper imentals were made better off financially. It 
also appears that, from the perspective of government budgets, the program 
could be expected to pay for itself. 

Program Context 

The OJT program which is the subject of this study operated tram 
October 1984 through June 1987. This was not, however, New Jersey's first 
effort to provide OJTs to welfare recipients. Indeed, the state had pre- 
viously nperafpd a large r-scale OJT program that was curtailed in the earlv 
1980s due to reduced federal funding for the WIN program. In 1984, New 
Jersey partially restored its OJT program after becoming one of six states 
chosen by the federal Office of Family Assistance (OFA) to participate in a 
demonstration of programs that used welfare grant diversion to fund wage 
subsidies. 

Administrative responsibilities for the OJT program were shared 
between the New Jersey Department of Human Services (DHS) and the New 
Jersey Department of I *^or ' s (DOL ) Division of Employment Services ( ES). 
ES staff were primarily responsible for developing OJT positions for 
program enrollees. DHS staff were primarily responsible for operating the 
grant diversion funding mechanism. 

The OJT program was operated in n 4 .ne of New Jersey's 21 counties — 
Atlantic, Burlington, Camden, Essex, Hudson, Mercer, Middlesex, Monmouth, 
and Passaic. Seven counties began the program in October 1984; Hudson and 
Middlesex began in mid-1985. New Jersey's largest cities are included in 
these counties, as are a number of smaller industrial and commercial towns. 



All of these counties shared in New Jersey's economic expansion during the 
mid-1980s, with each experiencing a declining unemployment rater However, 
these counties also included several areas of continued high unemployment. 

Enrollment in New Jersey' s OJT program was voluntary, but entry was 
restricted to adult AFDC recipients aged 18 and over who were single 
parents. Local ES job developers recruited program enrollees primarily 
from their county's active WIN caselo-d: that is, welfare recipients who 
were participating in or had recently completed a WIN employment or 
training activity. To be accepted into the program, recipients had to 
demonstrate interest in an OJT position and be considered employable by 
program sta^f. Both the experimental and controls in this study could 
therefore be expected to receive more services and have higher rates of 
employment than the New Jersey AFDC caseload as a whole. 

As in any aiT program, sane of the individuals accepted in New 
Jersey's program aid not actually work in OJT jobs. Enrollees — both 
those who entered OJT positions and tl ;se who did not — could take part in 
other WIN activities at any time after program intake. WIN activities 
included job search, ork experience, and referral to remedial education or 
vocational training. Enrollees could also participate in training 
activities administered through the state's JTPA system. 

Research Design and Data Sourceb 

A rigorous research design was used to determine the effects of adding 
the OJT rcaponent to the existing array of WIN and jr>A services. Half of 
the WIN registrants who applied for and were deemed appropriate for OJT 
employment were randomly assigned to an experimental group, which was 
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eligible for an on-the- job-training position as well a« other WIN and JTPA 
services. The other half were assigned to a control group, which was not 
given access to OJT jobs but remained eligible for all other WIN and JTPA 
activities. 

The evaluation therefore compares two program streams: regular WIN and 
JTPA services plus eligibility for an OJT position versus regular WIN and 
JTPA services alone. The report does not estimate the effect of offering 
only on-the-job training, as would have been the case if those in the OJT 
program were not eligible for any other services. It also does not 
evaluate the activities the experimental engaged in compared to a 'no- 
service" control group. 

The Impact of the program was estimated by comparing the post-random 
assignment employment, earnings, and welfare receipt for the experimental 
and control groups. Because the groups were equivalent except for the 
services available to them, any statistically significant differences 
between the outcomes for the two groups could confidently be attributed to 
experimental* eligibility for 0JC positions. Differences were considered 
to be statistically significant if there was no more than a 10 percent 
possibility that they would have occurred by chance. 

The analysis relied on two automated data bases to measure program 
outcomes. New Jersey's Family Assistance Management Information System 
(F**MIS) provided records of monchly AFDC payments for each sample member 
from 12 months prior to random assignment through August 1987. Employment 
and ed-nings data were obtained from the state's automated Unemployment 
Insurance (UI ) earnings system. However, since this system was not 
established until April 1985, complete employment and earnings data were 




not available for people entering the research sample between October 1984 
and March 1985. The employment and earnings data were reported on a 
quarterly basis, with each quarter representing a three-month block of 
time. The data were collected through the first quarter (i.e. , March) of 
1987. 

Additional sources of data were used to measure OJT employment, parti- 
cipation in alternative WIN and JTPA activities, and the costs of the OJT 
program. These data sources included OJT employment records, Employment 
Security Automated Reporting System (ESARS) records, the JTPA Automated 
Reporting System records, and published data on program participation and 
costs. Administrative reports and documents, and interviews with program 
staff were the key sources for studying the implementation of the OJT 
program. Client Information Sheets (CIS), which were filled out by job 
developers during program intake, provided information on the character- 
istics of research sample members. 

Characteristics of the Full Research Sample 

Sample members were a relatively disadvantaged group, according to the 
information recorded on the CIS. Three-quarters of the sample had been on 
welfare for at least two years during their lives and sample members 
averaged ever 18 months of welfare receipt during the two years prior to 
random assignment. Over half had not worked in the two years before random 
assignment. The sample was comprised almost entirely of black and Hispanic 
single mothers. 

Nevertheless, same factors suggested more favorable job prospects. 
Sixty percent of the sample reported having received a high school diploma 
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or GEO, and 83 percent reported having worked at some point in their lives. 
Further, the 45 percent of the sample who had been employed at any time 
during the two years before randan assignment reported working nearly 35 
hours a week and earning an average of $4.50 per hour. 

The Need to Use Subsamples in the Analysis 

Ideally, all questions of interest could have been addressed using the 
full research sample of \ 943 individuals randomly assigned between October 
1984 and June 1986. In particular, the key questions are the program's 
impacts in the short term (i.e., the first year after random assignment) 
and longer term (i.e., beginning with the fifth quarter after random assign- 
ment, when almost all experimentals had completed their OJT subsidy 
period). 

However, it was not possible to use the entire sample to answer both 
these questions for two reasons. First, as noted earlier, complete earn- 
ings data were not available for the 339 individuals randomly assigned 
before April 1985. Second, because the research schedule required fixed 
cut-off dates for data collection — March 1987 for UI earnings records and 
August 1987 for A"**-, payments records — different lengths of follow-up 
were available for jnJ; • :\«al<3 depending on when they entered the research 
sample. 

Therefore, the program's short-term impacts we,e determined by using a 
research sample of 1,604 people (called the khort-term impact sample ) that 
includes all individuals who were randomly assigned, except those entering 
the sample before April 1985 for whom UJ earnings data were not available. 
To measure the program's longer-term impacts, it was necessary to use the 



subsample of 994 individuals randomly assigned frcm October 1984 through 
September 1985. This early sample includes the only individuals for whom 
sufficiently long-term follcw-up data were available, i.e., seven quarters 
of earnings data and eight quarters of AFDC data. The early sample is also 
the primary focus of the implementation and benefit-cost analyses. 

On average, the early sample was somewhat less disadvantaged than both 
the research sample as a whole and the short-term irapacc sample. The early 
sample had less prior welfare receipt, more prior employment, and higher 
educational achievement. The more disadvantaged character of the sample 
members randomly assigned after September 1985 is associated with two 
changes that affected sample intake. First, improvements in New Jersey's 
economy during the second year of the program made it easier for more -job 
ready- individuals to find work on their own snd left those with greater 
barriers to employment on the welfare rolls. Second, Hudson and Middlesex 
Counties began operating the program in the simmer of 1985 and had a higher 
proportion of disadvantaged individuals. 



Findings on Program Implementation 

o The program averaged approximately 200 placements into OJT 
positions per year. Nearly 43 percent of all experimental 
worked at some point in an OJT position. 

The New Jersey OJT program placed more enrollees in OJT jobs than any 
of the other five states chosen by OFA to run a grant diversion demon- 
stration. However, the number of placements fell below anticipated ?.evels 
and failed to reach the yearly averages recorded in New Jersey during the 
late 1970s. Program staff cited several factors that constrained the 
number of placements: high turnover among OJT job developers; lack of appro- 
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prlate skills and motivation among some sample members; and lack of public 
transportation and day care facilities. The demonstration Itself (which 
made members of the control group Ineligible for CJT positions) was also 
cited as contributing to the program's Inability to meet Its original goal 
of 500 OJT placements per year. 

The program's performance seemed to improve during its second year. 
Forty-five percent of experiraentals randomly assigned between October 1985 
and June 1986 worked in OJT jobs, compared to 41 percent of experiment als 
randomly assigned before that time. In addition, the average wait between 
random assignment and the start of OJT employment decreased from eight 
weeks during the first year to four weeks during the second year of 
operation. 

o Slightly over half of the experiment als who worked in OJT 
positions completed the subsidy period, which averaged ten 
weeks. All but one of those completing the OJT were retained 
as unsubsidlzed employees. 

According to data reported by the state, 56 percent of OJT employees 
completed their trial employment period. All but one of those who complet- 
ed the trial period were retained as unsubsidlzed employees. Twenty-nine 
percent failed to complete the trial period for "good cause" reasons, such 
as inability to do the work; health, child care, or transportation 
problems; or quitting to take another job. Fifteen percent left their OJT 
1obs without good cause or were fired for excessive absences or lateness. 
OJT employees t rned an average of $4.43 per hoi r at the start of their OJT 
jobs. 

o Within 12 months of random assignment, 84 percent of experi- 
mental participated in at least one WIN or JTPA activity, 
including OJT employment. ' Although not eligible for OJT 
employment, 73 percent of controls participated in other WIN 
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or JTPA activities within 12 months of randca assignment. 
For 13,2 percent of experiment als, OJT employment was the only program 
activity during the first year of follow-up. Another 26.6 percent combined 
OJT employment with participation in one or more alternative WIN or JTPA 
activities, usually before the start of their OJT jobs. A third group, com- 
prising 44.1 percent of experimental, took part in WIN or JTPA activities 
but did not work in OJT jobs. At seme point during the first year after 
randan assignment, about 62 percent of experiment als were active in a Job 
Club or in individual job search; 7 percent were employed in unpaid work 
experience jobs; and nearly 21 percent took part in education and training 
activities sponsored by JTPA. 

Controls were also highly served and, except for OJT employment, their 
pattern of activities resembled that of experimentals. Over 66 percent of 
controls took part in job search, 8 percent in work experience, and 17 
percent in JTPA. Although a slightly higher percentage of controls parti- 
cipated in job search and work experience, and a analler percentage took 
part in JTPA, the experimental-control difference is less than 4 percentage 
points for each activity. Nearly a fifth of the control group participated 
in two or more activities. 

The high rate of participation by controls in WIN and JTPA services 
indicated that if the OJT program had not been available, many of those who 
were interested in and suitable for it would have participated in other 
services. 

o New Jersey spent a total of $1,642 per experimental to provide 
OJT employment and alternative WIN and JTPA services. The 
cost of providing WIN and JTPA services to controls was $782 
per person. The experimental -control (or net) difference in 
program costs was $860. 
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The OJT program spent $348 per experimental ($853 per OJT employee) in 
wage subsidies to employers. OJT administrative costs weie $500 per experi- 
mental ($1,226 per OJT employee). An additional $794 per experimental was 
expended for administration of job search, work experience, and training 
activities, as well as for general WIN and JTPA administrative costs. 

As noted earlier, experiment als and controls had comparable overall 
levels of participation in services other than OJTs. The experimental ' 
lower use of alternative WIN services and lower payments for childcare and 
training expenses were offset by higher participation in JTPA activities. 
Since experiment als' access to OJT positions did not reduce their overall 
use of alternative services, the net cost of adding the OJT component to 
the existing delivery system ($860) was almost identical to the cost of the 
OJT wage subsidies and OJT administration ($847). 

Findings on Program Impacts 

The impact findings described below should be interpreted in light of 
two key points. First, the impacts are analyzed from the perspective of 
the sample members, not of the government budget. Thus, no distinction is 
made between earnings from subsidized and unsubsidized jobs; similarly, 
AFDC expenditures for experimentals include only the payments made directly 
to them. The amounts diverted to subsidize OJT wages are not considered 
here, although they wil] be accounted for in the benefit-cost analysis dis- 
cussei Ipter. 

Second, impacts for the first year after random assignment are esti- 
mated for a 'short-term impact sample,' which consists of individuals ran- 
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domly assigned from April 1985 through June 1986. Longer-term impacts 
(i. e. , for the period beginning with the fifth quarter of follow-up and 
ending with the seventh quarter for earnings ar.d the eighth quarter for 
AFDC payments) are estimated for an "early sample" of individuals randomly 
assigned from October 1984 to September 1985. 

Short-term Impacts 

o The OJT program led to substantial employment gains in the 
first two quarters after randca assignment. These impacts 
then declined sharply. 

Employment rates for experimentals were 15.3 percentage points higher 

than for controls in the first quarter after random assignment and 13.1 

percentage points higher in the second quarter after random assignment. 

(See Table 1.) This increase appeared to result from expe. imentals working 

in an OJT position. By the fourth quarter, however, nearly as many 

controls as experime itals were working. This trend reflects the fact that 

seme experimentals left their OJT positions and that there was a steady 

increase in employment rates for the control group. Overall, experimentals 

averaged 2.28 quarters of employment during the first year, a statistically 

significant increase of 0.35 quarters compared to the control group. 

o The OJT program produced a statistically significant earnings 
gain of $654 during the first yea. after randen assignment. 
Average earnings for experimentals were 22 percent higher than 
average earnings for controls. 

During the first year after random assignment, experimentals earned 
$3,500 on average, compared to $2,866 for controls- (See Table 1. ) Earn- 
ings rose consistently for both groups throughout the year, but experimen- 
tals averaged roughly $120 to $220 more in every quarter. Since employment 
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TABLE 1 

SUMMARY OF SHORT-TERM IMPACTS OF THE NEW JERSEY OJ T PROGRAM 



Outcome and Follow-Up Period 


Experimental s 


Control s 


Di Herence 


Ever Employed* Quarters 1-4 


82. IX 


74. 7X 


7.4X*** 


Average Number of Quarters with 
En pi oyment • Quarters 1-4 


2.28 


1 .93 


0.35*** 


Ever Empl oyed 

Quarter of Random Assignment 
Quarter 2 
u uo r t e r j 
Quarter 4 


55. 4X 

61 .8 
5 5 3 
55.8 


40. IX 
48.7 
50.8 
53.3 


15. 3X*** 
13.1*** 
4.5* 

2.5 


Average i a tq i turnings* 
Quarters 1 -4 


$3500.06 


$2865.78 


$634.28*** 


Average Qurrterly Earnings 
Quarter of Random Assignment 
Quarter 2 
Quarter 3 
Quarter 4 


476.55 
916.73 
1 007 .89 
1 u y o . o y 


357.43 
699.08 
868.64 


1 19. 12*** 
217 .66*** 
139. 25** 
158.26** 


Ever Received AFDC, 
u ua r t e r s i * 


9 7 . 6X 


97 . 2X 


0.4X 


Average Number of Months 
Receiving AFDC* Quarters 1-4 


8.51 


9.13 


-0.63*** 


Ever Received AFDC 

Quarter of Random Assignment 
Quarter 2 
Quarter 3 

W UO 1 TBI * 

Quarter 5 


96. 6X 

Or./ 

73.3 

62.1 

54.7 


95. 2X 

0 7 fi 

78.4 
67.8 
60.7 


1 .4X 

-5.1** 
-5.6** 
-5.9** 


Average Total AFDC Payments. 
Quarters 1 -4 


$3104.51 


$3369.28 


-$264. 77*** 


Average AFDC Payments 

Quarter of Random Assignment 
Quarter 2 
Quarter 3 
Quarter 4 
Quarter 5 


1 007 .43 
838.75 
664.94 
593.39 
533.55 


996.50 
923.00 
774.55 
6Z5.23 
604.60 


1J.93 

- 84.25*** 

- 109.64*** 
-81 .84*** 
-71 .05*** 


Sampl e Size 


814 


790 





NOTES: These calculations include values ai zero for sample members 
not employed and for sample members not receiving AFDf. Iheie may be 
discrepancies In sums and difference* due to rounding. 

A two-tailed t-tes? was applied ta eoch difference between 
experimental and controi groups. Stotisticai significance levels are 
indicated a.; * = 10 percent; ** = 5 percent; **• 1 perc*n1. 
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gains were narrowing over this period, the persistence of earning gains 

through the fourth quarter suggests that experimentals worked in jobs that 

either paid more or provided more hours of employment than the jobs in 

which controls were employed, 

o Experimentals spent fewer months on AFDC and received $265 
less in welfare payments than controls during the first year 
after random assignment. 

Rates of AFDC receipt dropped steadily for both groups during the 
first year after random assignment; however, experimentals left AFDC 
faster. By the fourth quarter after random assignment, 62.1 percent of 
experimentals were receiving AFDC compared to 67.8 percent of controls. 
(See Table 1.) Overall, experimentals averaged 8.51 months on AFDC during 
the first year after randan assignment, while controls averaged 9.13 
months. 

During the first year after randan assignment, experimentals averaged 
$3,105 in welfare payments, an 8 percent reduction from the average of 
$3,369 paid to controls. From the second through fourth quarters, experi- 
mentals averaged between $82 and $110 less in welfare payments per quarter. 
These differences were all statistically significant. 

Longer- t arm Impacts 

o During quarters five through seven, when almost all the 
experimentals had completed the OJT subsidy period, there was 
little or no difference between the employment rates for 
experimentals and controls. 

Although 70.1 percent of experimentals and 66.9 percent of controls 
were employed at sane point during quarters five through seven, the differ- 
ence was not statistically significant and both groups averaged 1.7 



quarters of employment during this period* (See Table 2. ) A statistically 
significant employment gain for experimental in the fifth quarter was 
followed by two quarters in which controls actually hud slightly higher 
rates of employment, although the differences were not statistically 
signif leant. 

o During quarters five through seven, experimentals averaged 
$468 more in earnings than controls. This is a statistically 
significant increase of nearly 15 percent. 

During quarters five through seven, experiraentals averaged $3,627 in 
earnings, while controls averaged $3,159. (See Table 2 and Figure 1. ) 
Quarterly averages for both groups showed a generally upward trend, 
although increases were not as rapid as during tie first year. During 
quarters *ive and six, experimentals averaged about $173 more in earnings 
than controls. These differences were statistically significant. The $123 
difference in the seventh quarter was not statistically significant. As 
was the case in the latter part of the first year after random assignment,, 
earnings increases in the absence of employment gains suggest that enroll- 
ment in the OJT program gave experimentals access to higher pay or more 
hours of work. 

o During quarters five through eight, experimentals averaged 
nearly half a month less of AFDC receipt than controls and 
averaged $238 less in welfare payments. However, these differ* 
ences decreased somewhat over time. 

Levels of AFDC receipt continued to drop for both experiraentals and 
controls during this period, but the decline was faster for experimentals. 
(See Table 2. > In each quarter, a smaller percentage of experiraentals 
received AFDC payments than controls, although the difference was only sta- 
tistically significant in the sixth quarter. Overall, experiraentals 
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TABLE 2 

SUMMARY OF LONGER-TERM IMPACTS OF THE NEW J E.% :Y OJ T PROGRAM 



Outcome and Follow-Up Period 


Experimental s 


Control s 


Dl f f erence 


Ever Employed, Quarters 5-7 


70. IX 


66.9% 


3.2X 


Average Number of Quarters witf> 
Employment, Quarters 5-7 


1 .69 


1 .66 


0.03 


Ever Empl oy ed 
Quarter 3 
Quarter 4 
Quarter 5 
Quarter 6 
Quarter 7 


55. OX 

54.8 

56.9 

56.4 

56.1 


51 .5X 

55.2 

54.6 

56.7 

57.8 


3.5X 
-0.4 

5.3* 
-0.2 
-1.7 


Average Total Earnings, 
Quarters 5-7 


$3627 .43 


$3159.10 


$468.32* 


Average Quarterly Earnings 
Quarter 3 
Quarter 4 
Quarter 5 
uuarTer o 
Quarter 7 


881 .40 
974.33 
1 155 .09 
1259.79 
1 24 2 . 5 5 


841 .24 
939.52 
981 .25 
1087 . 82 
1090.03 


40. 15 

34.84 
173.83** 
1 Z 1 .97 * 

1 22.52 


Ever Received aFOC 
Guar ters 1-8 
Quarters 5-8 


98. OX 
60.7 


97. 7X 
62.9 


0.3X 

-2.3 


Average Number of Months 
Receiv'ng AFDC 

Quar ter s 1-8 

uuarTers bo 


14.24 
5.4 1 


15.06 
5.90 


-0.81 * 
-0.49 


Ever Received AFDC 

quarter of Random Assignment 

wuarier i 

Quarter 3 

Quarter 4 

Quarter 5 

Quarter 6 

Quarter 7 

Quarter 8 


97 .4X 

93 . 6 
74.8 
65 .8 
56.5 
50.6 
47.9 
45.7 


96. 3X 

91 .4 

77.7 

68.6 

61.5 

57.0 

51.7 

47.5 


1 .IX 

2.2 
-0.9 
-2.8 
-4.9 
-6.4«* 
-3.8 
-1.9 


Average Total AFDC Payments 
Quar ter s 1-8 
Quar ters 5-8 


$5133.51 
1 945 .94 


$5560.99 
2483.57 


-$427 .48** 
-237 . 63 * 


Ava rflnA AFDC PnvmAntc 

AVvlUUv MrL/l* r U y III O 1 1 1 9 • 

Quarter of Random Assignment 

Quarter 2 

Quarter 3 

Quarter 4 

Quarter 5 

Quarter 6 

Quarter 7 

Quarter 8 


998.55 
883.25 
91 .24 
614.52 
543 . 1 9 
493 . 73 
470.46 
438.56 


994.41 
930.69 
773.17 
6Z9. 1 5 
616.80 
576.85 
513.54 
476.38 


4.13 
-47.43** 
-81 .92*** 
-64.63** 
-73.61 «• 
-83.12** 
-43.08 
-37.82 


Sample Size 


b08 


486 





NOTES: These calculations include values of zero for sample members 
not employed and for sample members not receiving AFDC. There mav be 
di proper.*, ies in sums and differences due to rounding. 

A two-tailed t-test was applied to each difference between 
experimental and control groups. Statistical significance levels are 
indicated as: * = 10 percent; ** = 5 percent; *** = 1 percent. 
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FIGURE 1 



NEW JERSEY OJT PROGRAM. 

TRENDS IN QUARTERLY EARNINGS AND AFDC PAYMENTS 
FOR AN EARLY SAMPLE 
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averaged 5.41 months of AFDC receipt during quarters five to eigh^ while 
controls averaged 5.90 months. The difference is not statistically 
significant, however. 

During quarters five through eight, experimental received an average 
of $1,946 in welfare payments, an 11 percent reduction from the control 
group average of $2,lb4. (See Table 2 and Figure 1.) Experimental had 
lower average payments in each quarter, but the savings decreased fran a 
statistically significant $83 in quarter six to a not statistically 
significant $38 in quarter eight. 
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Findings from the Benefit-Cost Analysis 

The benefit-cost analysis estimates the financial gains or losses that 
resulted from adding the OJT program to the regular array of WIN and JTPA 
services. It is important to remember that these estimates, like the 
impact estimates, present the net results for the program compared to the 
benefits and costs of the substantial employment-related activities engaged 
in by controls. 

This analysis extends the impact results in several important ways. 
First, it includes not only the program's impacts on earnings and welfare 
payments, but also the effects on fringe benefits, tax payments, Medicaid, 
Food Stamps, and the adninistrative costs associat d with these transfer 
programs. These effects, which could not be measured directly, are imputed 
primarily from observed earnings and welfare impacts. 

Second, using a number of assumptions, the analysis projects program 
benefits and costs that are 1' ?ly to occur after the end of data collec- 
tion. This longer-range view is necessary because most costs are incurred 
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early, when participants are still active in the program, whereas benefits 
can be expected to accrue over a longer period as individuals continue to 
work and pay taxes. For this reason, the benefit-cost estimates are 
extended over a five-year period for each sample member, beginning with the 
date of randan assignment. Actual earnings and AFDC data are available for 
about the first two years of follow-up, which is called the "observation 
period. ■ For the remainder of the five years, effects are projected from 
data obtained during the observation period. Because the observation 
period is relatively short — and covers less than half )f the five-year 
benefit-cost period — considerable uncertainty surrounds the precise 
estimates in this analysis. 

Third, the benefit-cost analysis is concerned with how gains and 
losses differ depending on the perspective of different groups in society. 
The principal questions addressed are whether members of the experimental 
group become financially better off as a result of the program and whether 
government budgets show net gains or losses due to the program. Table 3 
displays these net gains and losses from the perspectives of the welfare 
recipients and the government budgets. 

It is important to recognize that while this analysis is compre- 
hensive, it cannot take into account all factors that are potentially 
relevant in interpreting benefit-cost results. For example, it does not 
include the possible displacement of other workers by any increased 
employment of exper inentals, or the intangible benefits associated with 
society's preference for work over welfare. 

Finally, it should also be noted that the findings reported below may 
be conservative estimates of the program's effectiveness. The results are 



TABLE 3 



EST 9 MATEO GAINS ANO LOSSES PER EXPERIMENTAL 
FROM THE PERSPECTIVES OF WELFARE RECIPIENTS ANO GOVERNMENT BU OG E 7 i 



Component of Anolysis and Perspective 


Estimate 


Welfare Recipients 








Goi ns 








Earnings and Fringe Benefits 








OJ T Erapl oyment 


$779 




Unaubsidized Employment 


143 2 


t 0 


2 57 1 


Losses 








Income. Soles and Payroll Taxes 


- 1 A 7 
0 0/ 


T 0 


-596 


AFDC Payments 


-652 


to 


-801 


Other Transfer Payments 


-201 


to 


-379 


WIN Allowance and Support Services 




- >1 




Net Present Vol ue 


971 


to 


1 554 


Government Budgets 








Gains 








Pay rol i Taxes 


$310 


to 


$46 9 


income and Sales Taxes 


226 


to 


383 


AFDC Payments 


652 


to 


801 


UIIIVI I 1 U 1 1 ) T o r r u y wic n T s 


20) 


to 


379 


Transfer Program Administration 


72 


to 


1 13 


Other W IN Operoti ng Costs 




39 




WIN Allowances and Support Services 




21 




Losses 








OJ T wage Subsi dies 


-348 




OJ T Operati ng Costs 


-500 




J TPA Operat i ng Costs 




73 




Net Present Val ue 


601 


to 


1 284 



NOTES: All benefits and costs are estimated for a five /ear time 
period beginning at random assignment and are expressed in 1986 dollars. 
Because of rounding, detail may not sum to totals. Results Include esti- 
mates of projected program effects beyond the observation period. The 
first number of each range assumes a straight line decay of impjcts to $0 
by the end of the five-year period; the second number assumes that the most 
recent program effects continue for each remaining quarter of the five-year 
period. The net present value is the sum of all gains and losses. 
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based largely on the benefits and costs for the "early cample. ■ There is 

some indication that the results would be more favorable if sufficient 

follow-up data had been available for the entire research sample. 

o Over a five-year period, enro.llees in the OJT program are 
likely to benefit by an estimate! $971 to $1,554 per person. 

From the perspective of the experimental s, the primary benefit of the 
prograr was their increased earnings and fringe benefits, estimated to be 
about $1,000 during the observation period. The principal offsets to these 
gains were the increased taxes experimentals paid and the lower amounts of 
AFDC, Medicaid, and Food Scamps they received compared to controls. During 
the observation period, the net effect of these benefits and looses was an 
average gain of $309 per experimental. 

Using alternative assumptions about the projected future effects of 

the program, the net benefits to experimentals over the full five-year 

period will probably be between $971 and $1,554. While experimentals 

clearly benefited financially from the program because they had net gains 

even within the observation ^riod, the precise magnitude of these gains 

over the full five years is much less certain. 

o From the perspective cf government budgets, the program can be 
ejected to pay for itself within about two and one-haK 
years. Net savings of betweer $601 and $1,284 are likely over 
a five-year period. 

From the perspective of government budgets, the principal gains were 
the increased taxes experin-ewcals paid and the reduced AFDC, Medicaid, and 
Food Stamps experimentals received compared to controls. The main cost to 
the government was the net increase in program expenditures for experimen- 
tals compared to controls. 

By the end of the observation period, all but about $90 of the $860 



net cost of the program had been recouped. With rec^onable assumptions 
about continued program effects beyond the observation period, it is likely 
that the program would breaJc even within about two and one-half years and 
would generate net savings o the government of between $601 and $1,234 
over a five-year period. Again, while the conclusion that there will be 
net savings is reasonably certain, the expected amount of the savings is 
unclear. 



Conclusions 

The finding that the program benefited those enrolled in it while also 
saving money for government budgets provides support for an OJT component 
to be included within the array of WIN services available to welfare 
recipients in New Jersey. It means that the program increased the income 
of AFDC recipients at no net cost to the government. However, the program 
was relatively small, and New Jersey, as well as other states, have found 
it difficult to run OJT programs for welfare recipients on a much larger 
scale. Therefore, the OJT program is probably best seen as an ef active 
but limited part of the state's overall employment services for welfare 
recipients. 
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CHAPTER I 



INTRODUCTION 

This report analyzes the implementation, impact, and cost-effective- 
ness of an on-the-job-training (OJT) program for recipients of Aid to 
Families with Dependent Children (AFDC) in New Jersey. The program was 
operated as one component of the employment and training services offered 
to welfare recipients through the state's Work incentive (WIN) Demonstra- 
tion system. 

Enrol lees in the OJT program, mostly female single heads of household, 
were eligible for placement in on-the-job-training positions with local 
employers. The employers (mainly in the private sector) agreed to hire one 
or more welfare recipients on a trial basis, pay them wages, and train and 
supervise them for a specified period of up to six months. Employers also 
agreed to retain individuals who performed satisfactorily during the trial 
period as regular full-time employees. In return, the state reimbursed the 
employers for half the wages paid to OJT employees during the trial period. 

The subsidy the state paid to employers was financed through a funding 
mechanism known as grant diversion, which is a way to convert welfare 
grants into wage payments for recipients. Under this process, the value of 
a welfare recipient's grant is held constant as of the time she enters an 
OJT position. The amount of the grant paid directly to her is then reduced 
to reflect her earnings in the job, as would be the case for any AFDC 
recipient with earnings. However, instead of returning the resulting 
welfare savings to the public treasury, these savings are used to subsidize 
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the wages that CUT employers pay to welfare recipients. (See Appendix A 
for a more detailed description of how the grant diversion mechanism 
works. ) 

The official name of the state's OJT program, the New Jersey WIN Grant 
Diversion Project, reflects the program's reliance on this funding mecha- 
nism, throughout this report, however, it will be important to keep in 
mind the distinction between on-the-job training, which is the program 
activity being studied, and grant diversion, which is merely a way to fund 
OJT wage subsidies. The analysis focuses on the impact and cost-effective- 
ness of providing on-the-job training to welfare recipients, not on the 
means of funding the program. * 

The OJT program was operated in nine of New Jersey's 21 counties — 
Atlantic, Burlington, Camden, Essex, Hudson, Mercer, Middlesex, Monmouth, 
and Passaic — and was restricted to adult AFDC recipients who were single 
parents. Participation was voluntary, but individuals desiring an OJT 
position first had to be accepted into the program. To be accepted, they 
needed to demonstrate interest in an on-the-joH-training position and be 
considered employable by program staff. 

It is important to emphasize, however, that many of those accepted 
into the program did not actually work in an OJT position. All of them 
"enrolled" in the program in the sense that job developers attempted to 
match them with available OJT job openings — often by sending prospective 
employers two or more OJT candidates to be interviewed for an available 
position. However, as is often the case in OJT programs, only ab?ut 43 
percent of these "enrol lees" in New Jersey's program were hired by OJT 
employers. 
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The other 57 percent (i.e. , those not placed in OJT positions) spent 
varying lengths of time waiting for a placement; many e/entually found 
unsubsidized jobs on their cvn, left welfare, or entered other employment 
and training activities. Although these individuals did not work in an OJT 
position, their contact with the program and their decision to forgo (at 
least temporarily) other employment-related activities may have affected 
their subsequent earnings and welfare behavior. 

The program* s enrol lees — both those who actually worked in OJT 
positions and those who did not — could take part in otuer WIN activities 
either before employment in an OJT position, after completing or dropping 
out of an OJT position, or as an alternative to employment in an OJT 
position. WIN activities included job search (supervised job clubs, 
individual job search, or referrals to unsubsidized jobs through the New 
Jersey Employment Service); work experience (up to 20 weeks of unpaid, 
part-time work at a government agency or not-for-profit organization); or 
referral to remedial education or vocational training. The program's 
enrollees could also take part in training activities administered through 
the state's Job Training Partnership Act (JTPA) system. 

I. The Setting for New Jersey's OJT Program 

New Jersey provides an important setting for studying an OJT program 
lor welfare recipients because it has a history of operating OJT programs 
and because its economy, while stt-adi'y improving, also I.as pockets of high 
unemployment. 

OJT programs for welfare recipients have been operated in New Jersey 
since 1969. Until 1981, the Employment Services (ES) Division of New 
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Jersey's Department of Labor offered OJTs as a regular component in the WIN 
system and paid employer subsidies out of general program funds. Following 
passage of the federal Omnibus Budget Reconciliation Act (QBRA) in 1981, 
however, federal funding for New Jersey's WIN budget was cut by 30 percent, 
leading to a drastic reduction in the OJT program. The state's Department 
of Hunan Services (DHS), which assumed overall responsibility for the WIN 
program after QBRA, contracted with ES to continue the administration of 
WIN services, including OJTs. However, DHS contracted fox only a few OJTs 
per year during this immediate post-OBRA period. 

In 1983, the U.S. Department of Health and Hunan Services, Office of 
Family Assistance ( OFA) inviued states to apply for demonstration funding 
to test the effectiveness of OJT programs using employer subsidies funded 
through grant diversion. New Jersey was one of nine states that responded 
to this invitation and one of six chosen to participate. (The other five 
were Arizona, Florida, Maine, Texas, and Vermont. ) 2 

This enabled New Jersey to revive its O t t program, although still with 
less funding than in the years before QBRA. 3 As with other WIN components, 
New Jersey DHS subcontracted with ES to operate the OJT program, although 
DHS retained oversight responsibilities. County ES staff, who were respon- 
sible for implementing the program at the local level, set a goal of 500 
OJT placements per year, equivalent to tie average nunber of placements 
durirg the pre-GBRA years. 

The UJT program that is the subject of this study ran from October 15. 
1984, through June 30, 1987. (The state had also operated the program as a 
pilot project from April through mid-October 1984. ) The research sample 
includes all WIN registrants accepted in the program from October 1984 
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through June 1986. 

Although New Jersey no longer receives federal demonstration funding 
for its OJT program, the state has continued to provide OJT employment 
opportunities f ^r welfare recipients. Starting in January 1987, New Jersey 
has been paying OJT administrative costs with funds made available through 
Title IV-A of the Social Security Act, a fundJng source that can also be 
used to operate work experience and job search programs. (The state has to 
bear a greater portion of program costs than under the previous funding 
arrangement. ) New Jersey continues to use diverted grants to fund OJT wage 
subsidies. Since the end of the demonstration, the state has extended the 
maximum length of an OJT contract from six to nine months, and has made OJT 
employment available to unemployed parents in two-parent households. At 
present, the a r u! program is operating in seven of the nine demonstration 
counties, plus Union. County. 

The present administrative and furling arrangements for running an OJT 
program will change when New Jersey finishes reorganizing its system for 
delivering employment and training services to welfare recipients. The 
state has replaced the WIN system, adninistered largely by ES, with a new 
program called Realizing Economic Achievement (REACH), "hich is admin- 
istered directly by county governments and subcontracted to county welfare 
agencies or other service providers. Grant diversion will continue under 
REACH, although the program has not begun in most, counties and institution- 
al arrangerai ts f^r operating an OJT program are still beir<<j worked out. 

During the period under study, New Jersey emerged from the recession 
oi the early 1980s and experienced strong economic growth. From 1984 to 
1987, when the OJT program was in operation, the statewide unemployment 



rate dropped from 6.2 percent to below 5 percent. (In each of these years, 
New Jersey's unemployment rate was lower than the national average. ) Job 
growth was particularly rapid in areas of the economy in which women have 
traditionally found employment: finance, wholesale and retail trade, and 



services. 



Despite the general trend toward lower unemployment, however, seme 
counties had uneraoloyment rates well above the state average* Four of 
these counties Atlantic, Essex, Hudson, and Passaic /which include, 
respectively, Atlantic City, Newark, Jersey City, and Paterson) — were 
included in the OJT program. 4 (see Table 1. 1. ) 

II. Research Questions and Policy Context 

This evaluation concerns the effects of adding the OJT component to 
the system of employment-related activities for welfare recipients regis- 
tered with WIN. The report does not estimate the effect of offering 
on-the-job training alone, as would have been the case if those who partici- 
pated in the OJT program were not eligible for any other services. Further- 
more, since the OJT program operated on a limited scale and was target- 
ed to a particular group ~ mostly female single-parent AFPC recipients who 
volunteered for and were accepted by the program — the findings apply only 
to a snail portion of New Jersey's AFDC caseload. This evaluation there- 
fore differs from most of MDRC's other recent studies, which have generally 
involved larger-scale mandatory programs. 

The effects of adding the on-the- job-training option were determined 
through a rigorous research design using random assignment. Half or the 
WIN registrants who applied for and were accepted by the program were 
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TABLE 1.1 
NEW JERSEY 

ANNUAL UNEMPLOYMENT RATES FOR COUNTIES IN THE OJ T PROGRAM 



County 


1984 


1985 


1 O O A. 

1 y 06 


AT 1 on T 1 c 


8 


4% 


7 


4% 


L 7 * 

0 . / * 


But 1 Ington 


4 


. 6 


4 


2 


j . y 


r 11 it. rl P n 

l U III U v II 


5 


8 


5 


2 


4 R 


Essex 


/ 


2 


7 


.5 


6.7 


Hudson 


1 0 


.0 


9 


.2 


8.0 


Me rcer 


5 


2 


4 


7 


4.3 


Middl esex 


5 


7 


5 


0 


4.4 


Monmouth 


5 


6 


4 


.5 


4.0 


Posso i c 


7 


.3 


7 


. 1 


6.0 


New Jersey stote 


6 


2 


5 


7 


5.0 



SOURCE: U.S. Deportment of Labor. Burecu of Labor Statistics. Local 
Area Unemployment Statistics, '984-1986. 



NOTES: 



Annual unemployment rates are not seasonally adjusted. 
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randomly assigned to an 'experimental' group eligible for an on-the-job- 

training position, as well as other WIN and JTPA services. The other half, 

who would normally have formed part of a larger pool available to fill OJT 

positions, were assigned co a 'control" group, which was not civen access 

to OJT jobs. Members of the control group were, however, eligible for all 

other WIN and JTPA activities. The evaluation therefore compares two 

program streams: regular WIN and JTPA services plus eligibility for an OJT 

position versus regular WIN and JTPA services alone. 

In particular, the evaluation seeks to answer the following questions: 

o Did welfare recipients accepted in the CJT program achieve 
higher employment rates or earnings than they would have if 
they cnly had access to regular WIN and JTPA services? 

o Did welfare recipients accepted in the OJT program spend less 
time on welfare or receive lower welfare payments than they 
would have if they cnly had access to regular WIN and JTPA 
services? 

o Did earnings gains for recipients accepted in the OJT program 
outweigh their losses in welfare benefits and other transfer 
payments? 

o Did the addition of the OJT program produce gains in tax 
revenues and savings in welfare and other transfer payments 
large enough to outweigh the costs of adding it to the WIN 
system? 

These questions are answered by comparing outcomes for the 988 members 
of the experimental group and the 955 members of the control group. In 
comparing these outcomes, it would not be surprising for experimentals, 43 
percent of whcm were placed in subsidized OJT jobs, to show short-term 
employment and earnings gains over controls, 5 On the other hand, since any 
reductions in welfare payments to these recipients were used to fund wage 
subsidies, one would not expect any short-term welfare savings from the 
perspective of the public treasury, indeed, the si- >rt-term cost of welfare 
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may be higher in a program funded by grant diversion, since some members of 
the control group can be expected to cycle off the rolls during the peiiod 
when the experimental 1 grants are frozen. 

For these reasons, an important aspect of the analysis is the 
program's effect on employment, earnings, and welfare receipt during the 
second year after program intake, when most experimental had finished 
their OJT employment, and welfare grants were no longer being diverted to 
subsidize wage payments. Since sufficient follow-up data are available for 
only about half the research sample, however, the longer- terra analysis 
focuses on this smaller group. 

The use of a randan assignment research design is central to the 
reliability of the eva* .tion of New Jersey's OJT program. When properly 
implemented, such a design yields experimental and control groups whose 
only systematic difference is in the program treatment available to them — 
in this case, eligibility for employment in an OJT position. The employ- 
ment, earnings, and welfare receipt of the individuals randomly assigned to 
the control group are therefore accurate benchmarks against which to 
measure the same outcomes for experiment als. Any statistically significant 
differences in the outcomes for the experimental and control groups can 
confidently be attributed to the effect of adding the OJT option to New 
Jersey's WIN system. 

This contrasts with most previous studies of OJT, which generally 
found positive imyr.cts for disadvantaged wcnea, but are open to serious 
question because methodologies less reliable than random assignment were 
used. In the absence of random assignment, one couid not determine whether 
apparent impacts were truly caused by the program or, instead, by differ- 
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ences between the two research groups on such important factors as motiva- 
tion. This is because, unlike random assignment evaluations which draw 
both the experimental and the control groups from applicants accepted by 
the program, the other evaluations identified control groups frcm individ- 
uals who might have been demographically similar to participants but had 
not applied for and been accepted into the program. it is entirely 
possible — indeed likely that individuals who apply for and are accept- 
ed by a program will differ systematically frcm those who do not. 6 

One demonstration program witli an on-the-job-training component which 
has been evaluated through a random assignment design was Maine's Training 
Opportunities in the Private Sector (TOPS) program. Like New Jersey's OJT 
program, TOrS was a voluntary option within the WIN system that involved 
eligibility for employment in OJT jobs in addition to other WIN services. 
MDRC's study of TOPS concluded that women in the experimental group who 
were eligible for employment in OJT positions were more likely to be em- 
ployed and had higher earnings than women eligible for regular WIN services 
alone. These gains were not accompanied by lower rates of welfare receipt 
or any welfare savings. 

There were important differences between Maine's TOPS demonstration 
and New Jersey's OJT program, however. Experiraencals in the TOPS demonstra- 
tion received a structured sequence of employment-oriented activities that 
usually began with pre-employment workshops, followed by unpaid work experi- 
ence, and only then by eligibility for an on-the-job-training position. In 
New Jersey, experimental could begin working in an OJT position at any 
point after random assignment. Participation in alternative WIN or JTPA 
activities was determined on an individual basis. The Maine and New Jersey 



programs also had somewhat different targeting strategies and intake 
7 

procedures. 

A study conducted in Dayton, Ohio, during the early 1980s also used 
random assignment to test the effects of a key element of an OJT program: 
payment of wage subsidies to promote the employment of disadvantaged 
people, Enrollees (most of wham were welfare recipients) in a job search 
workshop were randomly assigned to one of three groups. The first two 
groups were provided vouchers representing different types of wage sub- 
sidies, while a control group received no vouchers. Members of the two 
experimental groups were instructed to offer the vouchers to prospective 
employers. The Dayton experiment yielded negative impacts: Employers were 
less likely to hire participants who offered wage subsidies than controls 
who had no subsidy to offer. It has been suggested that this might reflect 
the stigma employers attach to welfare recipients who offer wage subsidies 

Q 

as an Inducement to be hired. 

As with TOPS, the Dayton experiment also differs from the New Jersey 
OJT program in several respects. In Dayton, participants sought their own 
jobs, and it was not necessarily assumed that training would occur once 
participants found employment. In New Jersey, job developers were respons- 
ible for finding OJT positions, and OJT employees were supposed to receive 
job-skills training from their employers during the OJT contract period. 

III. Overview o f th* Report 

Chapters II and III provide more detailed information on how the New 
Jersey OJT program was operated and evaluated. Chapter II discusses 
recruitment and intake procedures for the demonstration and the character- 



istics of the research sample. It also describes the data sources used in 
the evaluation. Chapter III describes how the program design was imple- 
mented and focuses on questions related to the program's scale: How close 
did the state come to its goal of placing 500 welfare recipients per year 
in OJT positions, and what factors influenced the scale of program options? 
Chapter III also contains a comparison of participation rates for experi- 
mentals and controls WIN and JTPA activities. 

Chapter IV contains the impact analysis, examining whether access to 
the CUT program produced higher employment and earnings or reduced welfare 
receipt for experiment als. Chapter V compares the economic benefits and 
costs of the program, focusing on two important perspectives: those of the 
welfare recipients eligible for the program and of the government budget. 




CHAPTER II 

RECRUITMENT OF THE SAMPLE AND RESEARCH DESIGN 

This chapter focuses on two topics critical to understanding the 
results of the study: the process by which eligible recipients were 
recruited for the OJT program, and the nature of the research design. It 
includes an explanation of the randan assignment process and the different 
samples used in the report, as well as a description of sample members. 
The conclusion of the chapter outlines and assesses the accuracy of the key 
data sources. 

I. Recruitment and Assessment 

Both WIN-mandatory recipients (those with children age six or older) 
and nonmandatory recipients (those with children younger than six were 
eligible for the OJT program. To participate, however, eligible individ- 
uals had to express an interest in OJT and meet specific criteria: They 
had to be at least 18 years old, a single head of household, and be living 
in one of the nine counties in which the program operated. 

Since the program sought to select recipients who could be placed in a 
job, primary responsibility for recruitment and assessment rested with a 
job developer from ihe WIN ctnif. Before random assignment, ,ne 1ob de- 
veloper interviewed each OJT applican 5 and evaluated her "job-readiness. ■ 
In doing this, the job develooers considered the recipient's educational 
level, work experience, motivation, and childcare needs. Although most of 
the screening criteria tended to narrow eligibility to those more likely to 
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find work on their own, several job developers stated that they also 
selected applicants who seemed unlikely to find jobs without assistance. 

There were several possible paths recipients could follow before reach- 
ing the job developer interview (see Figure 2.1), The roost common route 
was from Job Club, a group job search program which taught participants 
job-finding skills and provided them with phone banks and other ES-WIN 
resources to look for work. Job club participants were generally told 
about OJT during their second week, but job developers would sometimes seek 
out a participant earlier to fill a specific job opening. Therefore, same 
Job Club participants applied for entry into the OJT program within a day 
or two of starting the Job club. Another route to the job developer 
interview was through referrals by WIN staff who, through orientation/ 
appraisal or other components, judged a person to be 'job ready." 

There was no systematic effort to recruit from the general WIN- 
eligible population for the OJT program. 1 Rather, sample members were 
drawn from the subset of the WIN population that was already receiving WIN 
services and learned about the OJT program. This recruitment strategy has 
two important implications. First, the findings from the evaluation are 
not generalizable to the larger WIN population, and second, the control 
group was likely to be a heavily served population, since they were already 
active within the WIN system. 

II. Research Design and Samples 

Once accepted into the OJT program, enrollees were randomly assigned 
to either experimental or control status. A control group was included so 
that net program effects could be estimated by comparing the measured 

.51 

O -14- 

ERIC 



Figure 2 . 1 
New Jersey Research Design 
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outcomes (such as earnings and welfare receipt) of this group with those of 
the experimental group. Research has shown that a substantial proportion 
of AFDC recipients find jobs and leave welfare on their own, without 
receiving special services. 2 A valid control group makes it possible to 
distinguish this result from the effects of the program by contrasting the 
outcomes for two research groups who are similar in all respects except for 
the program treatment, 3 

Experimentals were eligible for OJT and all other WIN services. 
Controls were eligible for all WIN services, except OJT (see Figure 2.1). 
Both experimentals and controls were also eligible /or JTPA services as 
well as other services pursued on their own initiative. The control group, 
therefore, represents a benchmark of alternative program services, not of 
no services. 

A. Sample Build-up 

Random assignment was conducted from October 1984 through June 1986, 
during which 988 recipients were randomly assigned to the experimental 
group and 955 to the control group for a total of 1,943 sample members (see 
Table 2.1). Intake began in seven counties in 1984, and in Hudson and 
Middlesex counties in mid-1985. The sample build-up was slow during the 
first and second quarters, but accelerated in later quarters. 

B. Research Samples Used in the Analysis 

The primary purpose of this evaluation is to determine the program's 
impacts, both in the short term (when many of the experimentals were still 
in OJT positions) and the longer term (when substantially all of the 
experimentals had completed the OJT subsidy period). The longer-term 
effects are of particular interest because they provide a better measure of 



TABLE 2.1 

NEW JERSEY 

DISTRIBUTION OF THE RESEARCH SAMPLE, 
BY PERIOD OF RANDOM ASSIGNMENT AND RESEARCH GROUP 



Period of 

Random Assignment 


Exper imental s 


Cant ra 1 s 


Tatal 


Early Sample 


508 


486 


994 


Oct a be r -Doc em be r 19 64 


66 


66 


1 32 


J anua ry-Ma rch 1985 


108 


99 


207 


April-June 1985 


140 


138 


278 


July-September 1985 


194 


183 


377 


Later Sample 


480 


469 


949 


October-December 1985 


181 


174 


355 


J anua ry-Ma rch 1986 


159 


153 


312 


April-June 1986 


140 


142 


282 


Full Sample 


988 


955 


1943 


Short-Term Impact Sample 0 


814 


790 


1604 



SOURCE: Calculations from MDRC Client Information Sheets. 

NOTES: °The Short-Term Impact Sample includes sample members 
randomly ossigned between April 1985 and June 1966. 
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whether the program increased unsubsidized employment. Since almost all 
experimental in OJTs had completed the subsidy period within one year 
after randan assignment, the period beginning with the fifth quarter of 
follow-up is used to determine the program's longer-term effects. 

Ideally, both the short- anu longer-terra impacts would be measured for 
the full research sample of 988 experimental.^ ind 955 controls 7 andomly 
assigned from October 1984 through June 1986. This was not possible, 
however, because of two limitations on data availability. First, New 
Jersey did not establish an Unemployment insurance (UI) wage reporting 
system until April 1985. Jince, as will be discussed shortly, this was the 
source of earnings data for tM evaluation, there is no information on the 
first quarter or two of earnings for anyone randomly assigned from October 
1984 through March 1985. The second limitation is that the research 
schedule only made it possible to process earnings data through March 1987 
and AFDC payments data through August 1987. The fixed cut-off dates for 
data collection mean that there are different lengths of follow-up for 
different parts of the research sample, depending on when tney were 
randomly assigned. 

Because of these limitations on data availability, it was necessary to 
use somewhat different portions of the research sample to address parti- 
cular issues. The subsample used to examine the program's short-term 
impacts includes everyone for whom at least the first full year of earnings 
and AFDC data are available. This -short-term impact sample" thus includes 
everyone t 1,604 people) randomly assigned from April 1985 (when earnings 
data first became available) through the completion of random assignment in 
June 1986. (See Fiqure 2.2 and Table 2.2. ) 
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FIGURE 2.2 
DEFINTTION OF THE RESEARCH SAMPLES 



Random Assignment Month 



Ful Sample 
(N-1943) 



Snort-Term 
Impact Sample 
(N-1604) 



Early Sample 
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Later Sanple 
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Oct Dec Feb Apr Jun Aug Oct Dec Feb Apr 

1 l . I i l . l i l i i.i.i.i . 



Experimental* (388) 
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; &peHmert«ls;(508) 




Controls (488) 








Experimental (480) 




Control* (469) 
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1 ABLE 2.2 
NEW JERSEY 
DESCRIPTION OF THE RESEARCH f**PLES 





Period of 
Random 
Assignment 


1 

Fol low-Up 
Quarters Included 


1 




Sample 


Earnings 


AFOC 
Payments 


Principal use 
of the Sample 


Sample Size 


Ful I 


October 1964- 

I uno inn/ 

June 1700 


3-4 


1-5 


Short-term performance 
indicators; benefits and 
costs 


1943 


Short-Term 
Impact 


April 1985- 
June 1966 


1-4 


1-5 


Impacts during first year 
following random assign- 
ment 


1604 


Early 


October 1984- 
September 1965 


3-7 


1-8 


Longer-term impacts and 
benefit-cast estimates; 
short-Term performance 
indicators 


994 


Later 


October 1965- 
June 1966 


3-4 


1-5 


Tests the representative- 
ness af early sample 
findings 


949 



NOTES: Quarters are three-month periods that start on the first day of January, April, 
July or October. Quarter I is the three-month period in which the data of random assignment 
falls. Quarters 2 through 6 refer to three-monthperiods following the quarter of random 
assignment. 
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An overlapping but somewhat different sample was used to examine the 
program's longer-terra effects: that is, for the period beginning with the 
fifth quarter after random assignment, when almost all the experimental 
had completed the OJT subsidy period. Since sufficient earnings and AFDC 
follow-up data were only available for early entrants into the sample — 
those randomly assigned between October 1984 and September 1985 — this 
"early sample" was used to assess tne program's longer-term effects. 
Because of the importance of the longer-terra follow-up in an OJT program, 
the early sample will be the primary focus of this report, including most 
of the implementation findings in Chapter III, the longer-terra impacts in 
Chapter IV, and the benefit-cost analysis in Chapter V. 

The early sample of 994 people comprises 51 percent of the full 
sample. To understand how representative the experiences of the early 
sample are, MDRC also looked at a "later sample," which included indi- 
viduals randomly assigned from October 1985 through June 1986. This later 
sample, for which there is only one year of follow-up data, does not play a 
central role in the report; it is used only to help interpret the 
representativeness of the longer-terra findings for the early sample. 

C. Characteristics of the Early Sample 

Given the importance of the early sample in this report, the following 
description of sample members will focus on the early sample. Table 2.3, 
however, provides demographic information on the later and full samples as 
well as the early sample. Appendix Table B.l provides comparable informa- 
tion for the short-terra impact sample. 

The early sample was a generally disadvantaged population except in 
aducational achievement (see Table 2.3). Moid than three-fifths of this 



TABLE 2.3 



NEW JERSEY 

SELECTEO C „aCTER 1 ST I CS OF THE EARL Y, LATER AN 0 FULL SAMPLES, 
BY PERIOO OF RAN OOM ASSIGNMENT 



CnQ rQCTOriSTIC 


coriy bam p i e 


La Te r bOflopi e 


ru 1 l ban p I 6 


County (X) 








Atlantic 


1 1.6 


3.9 


7.8*** 


Purl i nfl t fl n 

our i iiiyiuii 


1 1 { 

1 1 • 9 


k 7 


0 7 * • • 




1 3 9 


12.0 


1 1 n 


Essex 


15.5 


12.5 


14.1* 


Hudson 


8.2 


14.9 


1 1.5*** 


M6 r ce r 


11.7 


2 5 7 


ID c «*« 

1 O • 9 


Ml WWl v 9 O A 


7 i 


9 • J 


\ fl *** 


M fl nm fl Lt t h 
m u i Mil uu i ii 


1 5 7 


7 C 
' * 9 


11 7 


Po S SQ i c 


9 A 

7.0 


1 1 < 


i n s 

1 U • 9 


sex (X) 








Feoal e 


95.7 


96.5 


96.1 


Male 


4.3 


3.5 


3.9 


WIN Status {%) 

win jiu IV) \ M i 








Ma nda t a r v 


7 9 fl 


fl ^ fl 


fl 1 7 * * 


N an- Ma n do tary 


7 0 7 


1 A 7 


1 fl 1*4 


Age (X) 








Less than 19 Yecrs 


0.2 


0.2 


0.2 


1 9-24 Yfto r s 


it c 
1 J . 3 


11 1 


11 A 


25-34 Years 


s n 9 


CI 1 
9J . 1 


CI A 
9 1.0 


35-44 Years 


7 fl S 
£0.9 


7 fl 1 
£ 0 * J 


7 fl A 


45 Years ar Mare 


7.6 


7.0 


7.3 


Average Age (Years) 


32.1 


32.1 


32.1 


Ethnicity (X) 








White, Nan-Hi spani c 


18.5 


13.7 


16.2*** 


B I ack, Nan-Hi spani c 


69.9 


70.7 


70.3 


H i spani c 


11.2 


15.1 


13.1** 


Other 


0.4 


0.4 


0.4 


Degree Received (X) 








None 


38.7 


41.7 


40.1 


GEO 


13.1 


8.3 


10.7*** 


High Schaal Oipiama 


48.3 


50.0 


49.1 


Average Highest Grade Completed 


1 1.3 


11.2 


1 1 .3 



( canti nued) 
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TABLE 2.2 


( cont i nued ) 






Chorocter i sti c 


Eor 1 y Sotnpl e 


Loter Sompi e 


Ful 1 Sompi e 


Moritol Stotus (X) 
Never .lorried 

Morried, Living with Spouse 
Morried, Not Living with Spouse 
Divorced or Widowed 


48.3 
4. 1 
25. 1 
22.5 


58. 7 
2.9 
22.0 
16.4 


53.4*** 

3.5 
23.6 
19.5*** 


Any Children (X)° 
Less thon 6 Yeors 
Between 6 ond 18 Yeors 


24.8 
85.3 


21.5 
88.0 


23.2* 
86.6* 


Averoge Number of Children 

Less thon 19 

Less thon 6 Yeors 
Between j ond 18 Yeors 


2.0 
0.3 
1.6 


1.9 

0. 3 

1 . 7 


2.0 
0.3 
1.6 


Prior AFDC Dependency (X) 
Never on AFDC 
Less thon 4 Months 
4 Months to 2 Yeors 
More than 2 Yeors 


1 .8 
6.0 
19.7 
72.5 


0.7 
5.0 
19.3 
75.0 


1.3* 
5.5 

19.5 

7^.7 


Averoge Number of Months on 
AFDC during Two Yeors prior to 
Random Assignment 


18,5 


18.6 


18.5 


Received AFDC during Yeor 
prior tw Random Assignment (X) 


93.6 


93.9 


93.7 


Averoge Amount of AFDC Received 
during Year pr^or to Rondora 
Assignment ($) , 


3299. 14 


3422.03 


3359.16 


Hel d o Job ot Any Time 

prior to Random Assignment (X) 


85.5 


80.2 


82.9*** 


Averoge Number of Months 
Employed during Two Yeors 
prior to Rondom Assignment 


4. 1 


3.6 


3.9 


Reported Earnings during Yeor 
prior to Random Assignment (X) 
None 

$ 1 - $ 1 0 0 0 
$1001-13000 
$3001- $5000 
Over $5000 


62.4 
21 . 5 
8.7 
4.0 
3.3 


70.9 
11.4 
9.2 
4.7 

3.8 


66.5*** 
16.6*** 

8.9 

4.4 

3.6 
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TABLE 2.3 (continued) 



Character I sti c 


Earl y Sampl e 


Later sampl e 


Ful 1 Sampl e 


For Longest Job Held during 
Past Two Years 








Average Hourly Wage Rate ($) 
Average weekl y Hours 


4.48 
^4.3 


4.55 
35.0 


4. 51 
34.6 


Sample Size 6 


994 


949 


1943 



SOURCE: Coiculatlons from MDRC Client Information Sheets a*d New Jersey OHS 
Family Assistance Management Information System. 

NOTES: Distributions may not add to 100.0 percent due to rounding. 

A chi-square test or t-test was applied to differences between early 
and later samples. Statistical significance levels are indicated as: * = 10 percent; 
** = 5 percent; = i percent. 

a 

Distributions may nat add to 100.0 percent because sample members can 
have children in both categories. 

b 

Calculations are from New Jersey DHS Family Assistance Management 
Inf o r ma t ion System. 



AFDC. 



Calculations include values of zero for sample members not receiving 



membe rs. 



Averages are for 485 early sample members and 387 later sample 



For selected characteristics, sample sizes may vary up to 17 sample 
points due to missing data. 
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group reported zero earnings for the year before random assignment, and 

nearly three-quarters reported being on welfare for more than two years of 

their lives. Though the majority had either a high school diploma or GED, 

almost two-fifths had neither. The early sample was overwhelmingly female, 

most (70 percent) were black, and almost half had never married. However, 

85.5 percent had held a job at some point in their lives, and those who had 

worked during the two years before random assignment averaged $4.48 an hour 

at their longest job. These data suggest that job developers accepted a 

variety of people — some with relatively fewer barriers to employment, 

others with significant disadvantages in the labor market. Compared to the 

regular New Jersey WIN caseload, the early sample had higher percentages of 

4 

high school graduates or those with GEDs, working-age people, and blacks. 
D. Differences between the Early and Later Samples 

To evaluate the generalizability of the early sample, the demographic 
characteristics of early-sample members were compared to those of later- 
sample members (see Table 2.3). Although the early sample was similar to 
the later sample overall, in some categories the two were notably differ- 
ent: county office; WIN status; never married; held a regular job prior to 
random assignment; never on AFDC; zero and low earnings; and ethnicity. 
The data show the early sample to be slightly less disadvantaged than the 
later sample. 

These statistically significant differences are most probably a result 
of labor market and population differences among counties. The sample 
build-up did not occur evenly across counties. The majority of sample 
members in Atlantic, Burlington, and Monmouth counties were randomly 
assigned between October 1984 to September 1985; whereas the majority of 
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sample members in Hudson, Mercer, and Middlesex counties were randomly 
assigned after September 1985. Members of the early sample were most 
likely to have had earnings in the prior year largely because counties with 
the greatest representation in the early sample had this characteristic. 
The counties also had different ethnic distributions: Hudson and Middlesex, 
in particular, had a higher than average percentage of Hispanics in their 
sample populations. 

In addition, it is likely that improvements in the New Jersey economy 
beginning in mid-1985, also contributed to differences between the early 
and later samples. More jobs meant that the more "job-ready" could more 
easily find jobs on their own, while the least able stayed on the welfare 
rolls. This change in the AFDC caseload probably affected the composition 
of the two samples. 

E. Random Assignment 

Random assignment succeeded in producing comparable experimental and 
control groups for the early sample (see Table 2.4). Although a few 
statistically significant differences between experiraentals and controls 
were found for measures of prior earnings and prior welfare receipt, 
neither research group appeared to be consistently better off than the 
other. The impact analysis will adjust for these differences. 

The full sample results (see Appendix Table B.2) also reveal some 
experimental and control differences on prior earnings and AFDC receipt, 
though the specific categories affected differ from the early sample. 
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TABLE 2.4 
NEW JERSEY 

SELECTED CHARACTERISTICS OF THE EARLY SAMPLE, BY RESEARCH GROUP 



Choroc ter 1 st i c 


Exper 1 mental s 


Cont ro l s 


Total 


r n 1 1 r. t w t m \ 
LOUnTy \ X ) 








At 1 ont i c 


1 1 .4 


11.7 


11.6 


Bur 1 ington 


11.0 


11.9 


11.5 


l um o u n 


11 9 
14.1 


1 1 A 


I I 0 
1 J • 7 


E S S 6 X 


1 5 A 


1 5 4 

Nil 


15.5 


Hudson 


8.9 


7.6 


8.2 


Mercer 


11.2 


12.1 


11.7 


Middlesex 


2 . 4 


2 . 5 


2 . 4 


Mo nm o ii t h 

fflvlilli v U 1 II 


i 3 i O 


1 <i fl 


1 5 7 


r u j * u • v 


7.0 


9 . 3 


9 . 6 


Cfiv ( % ) 








Fema 1 e 


96. 1 


95.2 


95.7 


Male 


3.9 


4.8 


4.3 


WIN Status (X) 








jnuiiuu i u I y 


Q 1 7 

0 1./ 


7 7 fl 


7 0 fl 
/ 7 ■ 0 


Ptoit'ionouT o ry 


IP 1 


9 9 9 


9 n 9 


Ago i*j 








Less than 19 Years 


0.2 


0.2 


0.2 


19-24 Years 


13.8 


13.2 


13.5 


2 5-34 Years 


4 9.0 


5 1.4 


5 0.2 


35-4 4 Yea rs 


29.1 


2 7.8 


28 . 5 


4 5 Years or More 


7 . 9 


7 . 4 


/ . 6 


Average Age ( Yea rs ) 


32.2 


31.9 


32. 1 


Ethnicity (X) 








White. Nan-Hispanic 


16.8 


20. 3 


18.5 


Black. Nan-Hispanic 


71.9 


67.7 


69.9 


Hispani c 


10.9 


11.6 


11.2 


Othe r 


0.4 


0.4 


0.4 


Degree Received (X) 








None 


39.6 


37.7 


38 7 


GEO 


12.3 


13.9 


13.1 


H i gh School 0 i p 1 oma 


48. 1 


48.4 


46.3 


Average Highest Grade Completed 


11.3 


11.4 


11.3 



( cont inued ) 
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TABLE 2.4 (continued ) 



inorocier i s t i c 


Exper i ment a 1 s 


i 

Controls 


1 

Total 


Marital Status (X) 
Never Mar r i ed 

Married, Living with Spouse 
Married, Not Living with Spouse 
Divorced or Widowed 


49.3 
4.5 
24.9 
21.3 


47.2 
3. 7 
25.3 
23.8 


48.3 
4.1 
25.1 
22.5 


Any Ch i 1 dren (%)° 
Less than 6 Years 
Between 6 and 18 Years 


22.7 
85.4 


27 . 1 
85. 1 


24.8 

85.3 


Average Number of Children 

Less thon 19 Yeors 
Less thon 6 Yeors 
oeTween o o n a 1 o Years 


2.0 
0.3 
I . 7 


1.9 
0.4 
1 . 6 


2.0 
0.3 
1.6 


Prior AFDC Dependency (%) 
Never an AFDC 
Less than 4 Months 
4 Months ta 2 Years 
Ma re than 2 Yea r s 


2.4 
6.7 
17.0 
74.0 


.2 
5.2 
22.6 
71.0 


1 .8 

6.0 
19. 7" 
72.5 


Average Number of Months an AFDC during 
iwa Tt»o is prior to Kon^ Assignment 


18.3 


18.7 


18.5 


Received AFDC during Year prior to 
Konaom Assignment (%) 


94. 1 


93. 0 


93.6 


Average Amount of AFDC Received during 
Year prior to Rondom Assignment ( $) 


3390.41 


3203. 74 


3299. 14* 


H«ld a Job ot Any Time prior to 
Random Assignment (%) 


86.8 


84. 1 


85.5 


Average Number of Months Employed 
during Two Yeors prior to Rondom 
Assignment 


4 . 3 


3.9 


4. 1 


Reported Earnings during Year 
prior ta Random Assignment [%) 
None 

$1 - $1 000 
$1001 -$3000 
$3001-15000 
Over $5000 


60.5 
25.3 
8.9 
3.2 
2.2 


64.4 

17 . 6 
8.5 
5.0 
4 . 6 


62.4 
21.5*** 

8.7 

4.0 

3.3* 



( cont inued ) 
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TABLE 2.4 (cont inued) 



Chorac fer 1st i c 


Expe r i me nto 1 s 


Control s 


Totol 


For Longest Job Held during 








Post Two Yeors 








Average Hourly woge Rote ($) 


4.49 


4.47 


4.48 


Average Weekly Hours 


33.9 


34 .6 


31.3 


Sample Size 6 


508 


486 


994 



SOURCE: Colculotlons from MDRC Client Informotion Sheets ond New Jersey DHS 
Fan My Assistance Manogement Informotion System. 

NOTES: Distributions may not odd to 100.0 percent due to rounding. 

A chi-squore test or t-test was opplied to differences between 
research groups. Stotisticol signif tconce levels ore mdicoted os: * * 10 percent; 
** = 5 percent; *** = 1 percent. 

°Distr ibut ions may not add to 100.0 percent becouse sample members can 
have children in both categories. 

b Col culotions ore from New Jersey DHS Fomily Assistonce Management 
Information System. 

C Ca I c u I ot i ons include values of zero for somple members not receiving 

AFDC. 

d 

Averoges ore for 256 experimentols ond 229 controls. 

6 For selected choroc ter isti cs, somple sizes moy vory up to 17 sample 
points due to missing doto. 
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III. Sources of Data 

This evaluation relied on many data sources (see Table 2-5). Admin- 
istrative records were used to measure outcomes and participation rates. 
Other documents provided demographic characteristics and more detailed 
participation information. Some qualitative information, such as inter- 
views with a sample of job developers, was used in conjunction with this 
quantitative information. Each data source is described below. 

A. Client Information Sheets (CIS) 

The CIS, designed by MDRC and filled out by program staff at random 
assignment, was the major source of demographic and socioeconomic character- 
istics for each sample member. it included data on age, sex, ethnicity, 
family composition, and educational attainment. It also included basic 
welfare and employment histories. Particular attention was given to each 
sample member's experiences in the two years before random assignment. The 
CIS was the only source of prior employment and earnings data. The CIS 
data were complete for 99 percent of all sample members. 5 

B. Administrative records on Earnings and AFDC 

Administrative records were the primary data source for the impact and 
benefit-cost analyses. 6 Table 2.5 sunmarizes the types of records data 
used and the length of follow-up for sample members enrolled during each 
quarter of random assignment. 

New Jersey unemployment Insurance (UI) Earnings Records . The 
state UI system provided data on the earnings of the sample members by 
calendar quarters. 7 since the UI system did not distinguish between earn- 
ings from OJT employment and earnings from unsubsidized jobs, the quarterly 
data on MDRC's automated analysis file also do not distinguish between OJT 
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TABLE 2.5 
NEW JERSEY 

LENGTH OF AVAILABLE FOLLOW-UP, BY DATA SOURCE AND PERIOD OF RANDOM ASSIGNMENT 



Data Source 



JTPA Tracking 
Records 0 



OJT Employment 
i Records 0 



Chi id Core and 

Training 

Related 

Expense 

Payments 0 

Quarterly 
Empl oyment 
and Earnings 



Monthly AFDC 
Gront Payments 



Last Data 
Aval lable 



ESARS Tracking May 1987 
Records 0 



Ma/ ',987 



May 1987 



May 1987 



First 
Cal endor 
Quarter 
of 1987 



August 1987 



Data Bog In 



Date of 
Random Assignment 



Date of 
Rondom Ass'gnmert 

Date of 
Random Assignment 

Date of 
Random Assignment 



Second 
Calendar 
Quarter 
of 1985 



12 Months 
prior to 
Rondom Assignment 



Period of Rondcwr Assignment 



Early Sample 



October - 
December 
1984 



January 
March 
1985 



April 

June 

1985 



July - 
September 
1985 



30 
Months 



30 
Months 



30 
Months 



Not 
Available 



8 c 
Quarters 



33 
Months 



27 


24 


21 


18 


15 


12 


Months 


Months 


Months 


Months 


Months 


Months 


27 


24 


21 


18 


15 


12 


Months 


Months 


Months 


Months 


Months 


Months 


27 


24 


21 


18 


15 


12 


Months 


Months 


Months 


Months 


Months 


Months 



Not 
Aval lable 



8 t 
Quarrers c 



30 
Months 



Not 
Available 



Quarters 



2; 
Months 



Not 
Avoi lable 



7 

Quorters 



24 

Months 



Loter Somple 



October - 
December 
1985 



January 
March 
1986 



Not 

Aval lob I e 



Quorters 



21 
Months 



15 
Months 



Quarters 



16 
Months 



April 

June 

1986 



12 
Months 



Quarters 



15 
Months 



NOTES: Data source names are ^script ive. The official source names ore provided : i the text. 

°Sample members randomly assigned during March, June, September, or December hove a fraction of a month less follow-up than the 
rest of the sample. 

b Data were for a rondomly selected subsample of 377 exper Imentols ani controls, randomly asslgnei between Januory ond June 1986. 
Earnings data were available for the third through the tenth quarters following random assignment. 
^ + + Earnings data were available for the second through the ninth quarters following rondom assignment. 
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and other earnings. MDRC used Social Security numbers to identify the 
sample members for whcm to collect automated earnings data. 

New Jersey did not have a UI wage reporting system until April 1985. 
Therefore, earnings data for follow-up quarters one and two are unavailable 
for the sample randomly assigned between October 1984 and December 1984; 
data for quarter one are unavailable for the sample randomly assigned 
between January 1985 and March 1985. 

For the early sample, seven quarters of earnings follow-up are avail- 
able. Only four quarters of follow-up are available for the entire sample. 
The first quarter (the quarter of random assignment) can include earnings 
before random assignment. 

It is important to understand that the UI data system can underesti- 
mate income because of unreported earnings. The UI measure of earnings 
does not include of f-the-books earnings, or the earnings of people who work 
in another state. In addition, some employers do not report earnings: 
Agricultural and domestic work are exempt, and seme employers may fail to 
file as required. Measures were, therefore, taken to determine the 
accuracy and completeness of the New Jersey UI earnings data. 8 This does 
not significantly affect the evaluation, however, because there is no 
reason to believe that tnere were differences in the reporting of experi- 
mental and control earnings, and therefore no reason to suspect bias in the 
experimental-control differences. A check of the UI earnings data actually 
received by MDRC against an alternative source of UI earnings records 
revealed a 95 percent match rate. 

2. New Jersey DHS Family Assistance Management Information 
System (FAMIS). FAMIS supplied records of the monthly AFDC payments made 



to each sample member. For analysis, these monthly payments were aggre- 
gated into calendar quarter amounts to match the way earnings are report- 
ed. 10 Therefore, the first quarter will most likely include one or more 
months of AFDC payments received before random assignment, just as the 
first quarter included some prerandcm assignment earnings. 

For all sample members who participated in OJT employment and had part 
of their grant diverted, the AFDC grant amounts reported by FAMIS represent 
the amount paid directly to the client. The amount diverted to the grant 
diversion pool is not included in reported AFDC outcomes for individuals. 
If an OJT participant's entire grant was diverted (i.e., the amount of her 
earnings made the individual ineligible to receive any AFDC grant payment), 
that person would remain in OJT but would not appear as an AFDC recipient 
in the outcome measure of AFDC receipt in the impact analysis. 

AFDC data were collected from October 1983 through August 1987. For 
each early sample member, therefore, data begin at least 12 months before 
random assignment and continue through 24 months beyond the month of random 
assignment; the full sample only have data for 15 months after the month of 
random assignment. 11 

C. Program Tracking 

MPRC uced multiple sources of data on program participation to measure 
the activity of sample members in various services. 

1. WIN Grant Diversion Project On-Board Summary Reports . These 
reports, which were basically OJT employment records, provided OJT start 
and stop dates. Job developers maintained monthly logs of pertinent 
information concerning OJT 1 contracts. 



2 * Employment Security Automated Reporting System ( ESARS ) . 

ESARS provided computerized data on program participation in WIN services 
as well as information on employment and deregistration. 12 information was 
collected from October 1984, the beginning of randan assignment, through 
May 1987. Sample members have 12 to 32 months of participation follow-up 
data, depending on their date of randan assignment. In counting activi- 
ties, only the first instance of each type of activity following random 
assignment was included; participation is thus somewhat underestimated, 
since it was possible to take part in the same activities more than once. 

In addition, MDRC sometimes used a different strategy for coding WIN 
activities than was used by ESARS. For instance, ESARS did not distinguish 
between ES referrals to unsubsidized jobs (a type of individual job search 
activity) and OJT job referrals. Therefore, MDRC did not count ESARS' 
records containing the codes for job development and job referral if they 
were dated piior to or during the same month as the start of an OJT job. 
Second, MDkC recorded each instance of OJT employment in its measure of 
"pntered employment- (see Table 3.3), although for seme OJT employees no 
•entered employment" record was entered into ESARS. 

3 - New Jersey JTPA Automated Reporting Sy stem, The JTPA system 
provided information on participation, from October 1984 to May 1987, in 
JTPA activities throughout the state. These data were used to monitor 
additional services received outside of WIN. Of primary interest was their 
use in measuring services that the control group received. 13 

4 * Job Developer Interviews. MDRC staff conducted two rounds 
of interviews, from March to April 1985 and from September to October 1986, 
with CXJT job developers. These interviews provided important information 
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on recruitment of enrollees and administration of the program. 

5. Direct Information from Research Sites. This included tele- 
phone conversations with state officials and published state documents. 
D. Program Costs 

1. Support Payments Records. Data on childcare and training- 
related expenses (TRE) payments for the period between January 1986 and May 
1987 were collected for a subsaraple of 377 experiment als and controls 
randomly assigned between January and June 1986. Childcare payment 
invoices maintained by the New Jersey DHS, Bureau of Employment Programs, 
and TRE payment records maintained by the New Jersey Department of Labor, 
Bureau of Unemployment Insurance Collateral Claims, were the sources of 
these data. 

2. Fiscal Records and Agency Reports , To estimate the costs of 
WIN services, the Grant Diversion Project, and JTPA services, MDRC used the 
automated program records described above in conjunction with fiscal 
records and aggregate data on program activities. Fiscal records and 
agency reports yielded information on staff costs for providing activities 
and support services, on the total welfare grants diverted, and on the 
overhead costs of operating the program. 
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CHAPTER III 

IMPLEMENTATION OF THE OJT PROGRAM 
AND THE CONTEXT OF THE DEMONSTRATION 

This chapter analyzes the implementation of the OJT program in the 
context of the full range of services available to experimentals and 
controls. Entrance into an OJT program can lead to a variety of employment 
and training experiences, all of which may influence subsequent employment 
and welfare behavior. Some enrollees move quickly into OJT jobs, complete 
their trial employment, an are retained as full-time, unsubsidized 
employees. Others never find CUT employment. In time, some members of 
this group stop waiting to be placed in an OJT job and begin other 
employment-related activities in an effort to find an unsubsidized job. 

Sometimes OJT employees also take part in other activities, especial- 
ly if the program takes a long time to place them in these jobs. For 
example, an individual accepted into this OJT program may first take part 
in a vocational training program to enhance her employability. Some 
individuals „ho start OJT jobs quit or get fired before the end of the 
contract period or at some point afterwards and return to the WIN system. 

It is against this background that three sets of issues are discussed 
in this chapter. First, the chapter seeks to answer basic questions 
concerning the operation of the OJT program, such as: How many people 
eligible for OJT employment were placed in OJT jobs? What factors affected 
the number of placements into OJT positions? How long did the typical OJT 
employee have to wait before starting her OJT job? How long did employment 
in a subsidized OJT job usually, last? How many OJT employees completed 



their trial employment? And how many were retained as full-time, unsub- 
sidized employees? 

Second, the chapter measures the use of alternative WIN and JTPA 
services by experimentals who worked in OJT jobs and experimentals who did 
not. Two questions are of particular interest: To what extent did OJT 
employees receive additional employment-related services? Did experi- 
mentals who failed to get an OJT job try other means to find unsubsidized 
employment? 

Finally, the chapter estimates the difference between experimentals* 
use of WIN and JTPA services and their expected use of services had they 
not had access to OJT employment. This is accomplished by comparing the 
participation rates of the experimentals and controls. As explained in 
Chapter I, controls were eligible to participate in all WIN and JTPA 
services except the OJT program. 

In this cnapter, the discussion of how the OJT program operated 
accounts for the experiences of all the experimentals. However, the 
detailed quantitative analysis of OJT employment and participation in 
alternative WIN and JTPA activities focuses on the 508 experimentals and 
486 controls who compri r the early sample, which the key sample for 
analyzing longer-term program effects. Equivalent tables for the full 
sample can be found in Append i" C. 
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I. A dministrative Setting of the OJT Program 

During the period under study, the New Jersey WIN Demonstration 
Program was operated by the New Jersey Department of Labor (DOL), 
Employment Services (ES) Division, under* contract with the New Jersey 



-37- • • 



Department of Human Services (DHS). (The ES also provides job search 
assistance for unemployed people not on welfare. ) In eight of the nine 
counties participating in the CUT program, WIN staff worked in ES offices, 
had access to the agency's job bank, and shared information on area employ- 
ment opportunities with regular ES job developers. Some WIN services were 
delegated wholly or in part to program staff from county welfare agencies 
or DHS, Bureau of Employment Programs, including counseling, arranging for 
childcare and other support services, appraising new registrants, and 
running job clubs. WIN staff also referred clients to JTPA and other 
education and training providers. 

New Jersey's OJT program was a small component within the WIN Demon- 
stration Program: During the second year of the OJT program, WIN regis- 
tration in the nine OJT counties averaged about 80,000 per month. However, 
OJT job developers accepted only about 100 persons a month into the demon- 
stration and randomly assigned half of them into the experimental group, 1 

Like other WIN Demonstration programs, New Jersey's program offered 
job search, work experience, and referral to education and training 
programs. The most heavily used component was job search, both individual 
and group. Group job search, or Job Club, involved one week of classroom 
instruction (resume' writing, job search, and job interview strategies, 
etc. ), followed by a week of supervised job search. Participants in Job 
Club had access to WIN phone banks, ES job listings, and other resources. 
WIN staff also supervised individual job search activities — primarily for 
clients who had already completed Job Club made lob development 

contacts, and referred clients to employers who had advertised job openings 
with the ES. 
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Registrants could also take par 4 * in WIN Demonstration work experience, 
which involved up to 20 weeks of part-time, unpaid work at a government 
agency or not-for-profit organization, or they could enroll for up to one 
year of remedial education or vocational training sponsored by JTPA or WIN 
subcontractors. (Sane registrants entered education or training programs 
on their own initiative; others were referred by WIN staff. ) Participants 
in WIN job search, work experience, and WIN-sponsorei education and train- 
ing activities were eligible for support payments for transportation; for 
books, uniforms, or other training expenses; and for day care reimburse- 
ment. 



II. Implementation of the OJT Program 

From October 1984 through December 1986, OJT job developers and New 
Jersey employers signed 447 contracts for employment of sample members in 
subsidized OJT jobs. (No new contracts were written for experimentals 
after this date, although a few experimentals continued working in OJT jobs 
during the first half of 1987. ) During these 27 months, the program aver- 
aged nearly 17 new OJT jobs per month or 200 per year. (See Figure 3.1. ) 
However, the pace of OJT job creation was uneven. Between October 1984 and 
March 1985, few experimentals were working in OJT positions. The most 
active period of OJT placements occurred over the following 12 months, when 

two addit ional countie-s, Hudson and Middlesex, came into the pi ogram. 

2 

Relatively few experimentals were employed in OJT jcbs after April 1986. 

At some point during the follow-up, 423 out of 988 experimentals (42.8 
percent) worked in OJT jobs. Twenty-four experimentals ( 2. 4 percent ) 
worked in a second OJT job. Over time, job developers became more 

7 7 
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FIGURE 3 . 1 




ERIC 



successful at* placing experimentals in OJT jobs: Whereas 40.7 percent of 
experimentals in the early sample (randomly assigned between October 1984 
and September 1985) were employed in OJT positions, the corresponding 
percentage for later sample experimentals ( randomly assigned between 
October 1985 and June 1986 ) was 45 percent. During the demonstration, 
starting hourly wages for OJT employees averaged $4.43. Nearly 56 percent 
of OJT employees completed their trial employmenc, and all but one member 
of this group was retained as an unsubsidized employee. 3 

The percentage of experimentals employed in OJT jobs Vw^ried by county. 
(See Table 3.1 for the early sample and Appendix Table C. 1 for the full 
research sample. ) For the early sample, Hudson County recorded the highest 
percentage of experimentals employed in OJT jobs (64.4), followed by Essex 
(51.9), and Mercer (50.9). However, in five of the remaining six counties, 
fewer than 35 percent of experimentals were employed in OJT jobs. (In 
Camden County, the percentage was 41.7.) For the full sample, the 
percentage of experimentals employed in OJT jobs ranged from 25 percent in 
Middlesex to 62.2 percent in Hudson, with only Hudson and Camden (58.6 
percent) employing more than half of this experimentals in OJT jobs. 

On average, OJT employees in the early sample waited nearly two months 

between random assignment and the beginning of OJT employment. (See Table 
4 

3.1.) However, the time between random assignment and the start of an OJT 
j >b varied considerably by county, ranging from 4.2 weeks in Essex to 12.2 
weeks in Monmouth. During the second year of the demonstration, the wait- 
ing period to the start of an OJT job was cut in half, resulting in an 
average of about six weeks for the full research sample. (See Table C. 1. ) 
OJT employees worked for a little over ten weeks, on average, before 
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OJT EMPLOYMENT RATES, NUMBER OF WEEKS TO OJT START 
AND AVERAGE LENGTH OF OJT EMPLOYMENT, BY COUNTY 
(EARLY SAMPLE) 
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becoming unsubsidized employees or leaving their OJT jobs (the average 
length of stay remains the same when all OJT employees randomly assigned 
after October 1985 are included). Once again, there was considerable varia- 
tion by county: The average number of weeks in an OJT job ranged from 5.1 
in Middlesex to 13.5 in Mercer. (A range of similar magnitude is displayed 
in Table C. 1. ) 5 

These indicators highlight both the success and the limitations of New 
Jersey's CXJT piogram. The New Jersey OJT program placed more enrollees in 
OJT jobs t.ian r.ny of the other five states chosen by OFA to run a grant 
diversion demonstration. On the other hand, the 200 new OJT jobs per year 
achieved by the New Jersey program fell well below the yearly target of 500 
(later reduced to 350) which the state's program administrators had set. 
(It is common for OJT programs to place fewer enrollees than expectsd. ) 

OJT employment goals were projected to match the performance of the 

program prior to QBLA, which it did not do. * However, according to two 

other indicators of program success, the percentage of OJT employees who 

completed their trial employment (55.6) and the percentage of 'OJT 

completers" who were retained as unsubsidized employees (99.6), New 

Jersey's OJT program performed as well as or better than the WIN OJT 

7 

program had performed prior to OBRA. 

In the sections that follow, the discussion will focus on the details 
of running the OJT program in New Jersey. The description of the program 
is based largely on information provided in interviews conducted duilng 
September and October 1986 with each of the procrram's ten local OJT job 
developers; in interviews with three former job dcvelopeis ; and in periodic 
discussions with program administrators. Interviews conducted during March 




and April 1985 with job developers in five of the seven counties that were 
running the program at that time provided additional information on the 
program during its start-up phase. Topics include the job development 
process, the strategy for matching sample members to available OJT jobs, 
and the factors that influenced the number of placements achieved by the 
program. 

A. Staffing and Organization 

As discussed in Chapter II, job developers had primary responsibility 
for program intake. They were also responsible for developing OJT posi- 
tions, negotiating contracts, matching enrollees to OJT jobs, monitoring 
the progress of each OJT employee during her trial employment period, pre- 
paring the invoices for paying employer subsidies, keeping records, and 
preparing monthly reports on the proqram. Job developers received the 
title of Employment Services Specialist III, which ranked them one level 
above an entry-level professional within the ES/WIN organizational 
structure. 

This relatively lew status contributed to a high rate of turnover 
among the job developers, which adversely affected the implementation of 
the program. The principal cause of the movement of ES and WIN employees 
in and out of the position of job developer was the general reduction of 
New Jersey's WIN budget following OBRA. For example, in FY 1981, the last 
fiscal year prior to OBRA, New Jersey WIN spent nearly $1,5 million for OJT 
subsidies and program administration. By contrast, during FY 1986, the OJT 
proqram spent only about $600,000 for cut waqe subsidies and administrative 

g 

costs. The reduction in federal spending for WIN forced New Jersey DOL to 
cut back the number of ES WIN staff positions and reduce services to 
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welfare recipients. 

Following New Jersey civil service regulations governing Reductions in 
Force, WIN staff at higher titles were th* demoted to Employment 
Specialist III despite lack of experience. Many of these sought promotions 
as jobs became available. Some individuals who were already working as ]ob 
developers were required to transfer to other counties in order to maintain 
their civil service ranking. In all, only one of the seven original grant 
diversion counties had a job developer who remained on the job from October 
2 984 through the end of the project. According to job developers and 
program administrators, Reductions in Force and staff turnover created a 
situation in some counties in which new job developers came into unfamiliar 
labor markets and had to lea^n their jobs an \ make new contacts with area 
businesses before they could perform effectively. In some counties, 
however, the OJT program hired job developers who were experienced at 
writing OJT contracts through prior work with ES/WIN, CETA, or JTPA. 

Lack of funds also forced OJT program job developers in most counties 

to devote at least part of their work day to other duties in the WIN 

system. Only four of the nine grant diversion counties (Camden, Mercer, 

Monmouth, and Passaic) budgeted for full-time job developers; and in one of 

these, the two job developers interviewed stated that they spent 35 to 50 

percent of their time as regular WIN counselors, referring clients to 

o 

unsubsidized jobs made available through the ES. In the other five grant 
diversion counties, job developers' time was paid out of regular WIN finds; 
and four of the seven job developers interviewed staged that they spent 50 
percent or less of their time performing tasks connected to the OJT 
program. (Two uore estimated that tn'ey worked 7d percent of the time. ) 



During the rest of their working day, job developers in these counties 
performed a variety of functions within the WIN system, including referrals 
to unsubsidized employment, counseling, supervising individual job search, 
referrals to work experience positions, and recordkeeping. 10 As one job 
developer put it, "since the RIF [reduction in force], everyone around here 
wears ten hats." Budget cuts al-o eliminated childcare and transportation 
payments for OJT program participants after October 1985. 
B. The Job Development Process 

Most job developers interviewed stated that the majority of OJT place- 
ments resulted frcro their contacting area employers and working out an OJT 
contract. Half the job developers stated that they sometimes used ES job 
listings or want ads in local newspapers and then contacted employers. 
Less frequently, employers came to ES/WIN and asked to sponsor an OJT 
position. According to job developers, few enrollees conducted their own 
job development. ^ 

Most job developers stated that they did not seek out OJT positions on 
the basis of their potential for skills training. Getting welfare clients 
employed wa3 a higher priority, even if the job devPlopers believed that 
the employer was looking for someone who could work productively right 
away. All job developers, icwever, asserted that they sought OJTs with 
employers who would provide medical benefits. In seven of nine counties, 
job developers stated that they would not usually write an OJT contract for 
a job that paid less than $4 per hour. 

OJT ]obs varied by county, in part because of the character of local 
job markets and in part because one or more employers within particular 
counties sponsored multiple OJT posiLiOiii*. Fui iu^LcuiCe, in Atlantic 
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County, both JTPA and the OJT program placed clients into jobs in casinos; 
in Mercer County, which includes Trenton, the state capital, government 
agencies were an important source of employment; in Camden County, a number 
of experimentals worked at industrial laundries; in Middlesex County, six 
out of the county's ten OJTs were for assembly jobs at one electronics 
firm; and in Passaic County, two employers accounted for 20 OJTs in packag- 
ing and material handling. The majority of OJT positions were clerical 
jobs ( clerk/ typist ; secretary; mail clerk; data clerk; receptionist; 
cashier; bank teller; bookkeeper; shipping clerk); service jobs (nurse's 
aide; teacher's aide; laboratory assistant; food service worker; security 
guard; janitorial staff; laundry worker); or packaging, assembly, or light 
manufacturing jobs (inspector; packager; assembler; collator; material 
handler ). 

JuL developers offered a variety of reasons for their success in 
placing welfare recipients. Veterans of the ES stated that they drew on 
longstanding relationships with area businesses for placements through the 
OJT program; and one job developer stated that businesspersons in her 
county were well informed about OJT contracts through the OJT program and 
through a similar program run by JTPA. Two additional job developers 
claimed that OJTs were available for those job developers who worked 
energetically to find them. 

In six of the nine counties, job developers stated that they had 

greater success in placing OJT part lclpants with small or medium-sized 

12 

companies than witi large employers. The most common reason given was 
that the wage subsidy was more likely to attract a small employer to tl . 
program tr n a large employer. Job developers also cited difficulties in 
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convincing large employers to hire disadvantaged women with little work 
experience or training. Further, in counties whooe velfare populations 
included a high percentage of Hispanics (Hudson, Middlesex, and Passaic), 
job developers cited problems in placing welfare recipients who did not 
speak English. Three job developers also stated that large employers were 
located away from the central cities and were not accessible through public 
transportation. 

C. Characteristics of OJT Participants 

In trying to fill OJT positions, job developers sometimes had to weigh 
conflicting factors. First, they needed tc maintain good relations with 
area employers to encourage future use of the program. This meant that 
they needed to choose candidates who would both make a good impression when 
they interviewed for a job and were likely to perform their jobs well 
enough to be retained after the trial employment period. On the other 
hand, job developers expressed a commitment to helping disadvantaged people 
find better jobs than they were likely to find on their jwn. 

Most job developers expressed a concern that candidates for available 
OJT positions be appropriate for the jobs at hand. Job developers stated 
that they read client profiles and interviewed current and prospective 
enrollees, trying to find clients whose work experience, skills, and 
interests matched the requirements of available OJT jobs. Good work 
habits, good appearance, positive attitude, and motivation were also c<ted 
as characteristics that attracted job developers to particular clients. 
Half the job developers also stated that they "hedged their bets" by 
sending more than one client to int?rview for the same OJT position. 

Sometimes, when job developers believed that enrollees in the OJT 



program lacked the skills or experience to fill an available OJT position, 
they asked colleagues at ES/WIH to recommend a welfare recipient who 
appeared to have the appropriate background and then recruited that person 
for the program. Normally, this strategy of trying to fill available jobs 
from outside the ranks of current enroilees would increase the likelihood 
of an OJT placement (although if carried out frequently enough, it could 
also result in many enroilees never finding OJT employment). However, 
random ajsignment often foiled this strategy, since half of these prospec- 
tive OJT employees recruited by job developers were randomly asi igned to 
the control group. For this and other reasons, OJT job developers cited 
random assignment as a hindrance to their jobs. 

The comments of job developers suggest that enroilees who were placed 
in OJT jobs were more job-ready than those who were not. However, thes<* 
comments are only partially reflected in the demographic characteristics of 
OJT employees. (See Tables 3.2 for the early sample and C. 2 for the full 
sample. ) Among experimentals in the early sample, 44.4 percent of high 
school graduates worked in OJT jobs, compared to only 36 percent of high 
school dropouts. Likewise, experimentals who had worked in a regular job 
at some point were more likely (Ly nearly 6 percentage points) to be 
employed in an OJT job than experimentals who had neve" held a job. On the 
other hand, the percentage of OJT employees among experimentals who had 
received welfare for more than two years in their lives (42.7 percent) was 
hiahej than the corresponding percentages for txpe^imentals who hao shorter 
histories of welfare receipt. Similarly, a higher percentage of 
experimentals who reported no earnings during the year prior to randan 
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NEW JERSEY 

ON-THE-JOB TRAINING EMPLOYMENT RATES WITHIN SELECTED SUBGROUPS 

(EARLY SAMPLE) 
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assignment were placed in OJT jobs than experimental who had reported 
earnings. 13 

These indicators capture only a few dimensions of job-readiness and do 
not account for personal characteristics such as motivation to work or 
self-confidence. Still, the data suggest that th3 ranks of OJT employees 
included many whose demographic charact?ristics and employment and welfare 
histories would normally place them at a disadvantage in the labor market. 
Further, as the program took in a higher percentage of sample members with 
significant barriers to employment, OJT employment rates among more overtly 
disadvantaged sample members improved over time. 

D - Job Developers' Assessment of the Program 
Nearly all the job developers interviewed believed that OJT programs 
benefited welfare recipients and hoped that New Jersey would continue to 
run an OJT program funded by grant diversion. However, they also 
criticized the program and suggested ways to improve it. In addition, job 
developers cited several reasons why the number of placements would 
probably be limited under any circumstances. 

When asked why more enrollees weren ( t placed in OJT jobs, nearly all 
the job developers interviewed pointed to at least one problem with the 
labor market in their area that hindered their efforts to place welfare 
recipients into OJT jobs. These problems included: a shortage of entry- 
level jobs that offered training; a shortage of jobs that paid enough to 
compensate for the loss of welfare and other benefits; the inaccessibility 
of jobs for individuals who had to rely on public transportation; the 
unwillingness of employers to hire welfare recipients; and prejudice 
against minorities or non-English speakers. Further, in six of the nine 
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counties, job developers felt that ES/WIN had fewer opportunities to place 

a client tn ,.n OJT job than it had at the beginning of the decade. In 

three counties, job developers blamed economic changes, especially the 

movement of large employers out of the area. Four job developers stated 

that they had lost access to state and county agencies as OJT employers 

because of cuts in agency budgets. In three interviews, job developers 

also cited competition with JTPA's OJT program as a factor that worked 

against placing welfare clients through the OJT program. 

The job developers also commented that random assignment denied them 

access to those individuals best suited to fill OJT positions. More than 

half of the job developers claimed that they lost OJT positions altogether 

because they couldn't find a comparable candidate among the experimentals. 

Additional reasons given for the shortage of employable welfare recipients 

included the overall drop in New Jersey's welfare caseload and regulations 

governing the OJT program that prevented the inclusion of unemployed 

parents in two-parent families (AFDC-Us) — AFDC-U recipients were eligible 

for OJT jobs during the WIN OJT program prior to OBRA and became eligible 

again in January 1987, when New Jersey started funding the program with 
14 

Title IV-A money. 

Most job developers* felt that the program would have employed more 
enrollees had more funding been available for job development and had OJT 
employees been eligible to receive transportation and childcare payments. 
Three job developers complained that the state ought to have publicized the 
OJT program more effectively, and two asserted that it was slow to re- 
imburse employers for OJT wages. 



III. Participation of Exper Imentals and Controls 
In OJT and Other Activities 

This section describes the participation of experiraentals in WIN and 
JTPA activities within 12 months of random assignment. As previously 
discussed, CUT employees could also participate in alternative WIN and JTPA 
activities prior to or after OJT employment. In fact, all but WIN volun- 
teers (18 percent of the sample) were required to participate in alter- 
native employment-related activities if they wero not placed in OJT jobs. 

Table 3.3 displays the full range of WIN and JTPA activities in which 
experimentals were active during the 12 months following randan assignment. 
The data demonstrate that experiraentals used WIN and JTPA services 
extensively. During the 12 months following randan assignment, 83.9 
percent of experimentals were active in one or more WIN activities, 
including OJT employment, or in JTPA activities. The most ccmmon activity 
was job search (62.2 percent). Participation in Job Club, individual job 
search, job developer contact, and job referral were considered job search 
activities. OJT employment (39.8 percent) was the second most used 
service. A email percentage of experiraentals (6.9 percent) also 
participated in work experience. However, a relatively high percentage of 
experimentals (20.7 percent) participated in a JTPA activity. There was 
generally little difference in participation of experimentals for the early 
sample compared to the full sample, although participation in 
JTPA-sponsored activities was somewhat more common in tha early sample (see 
Appendix Table C. 3 ). 

Experiraentals who participated in one activity often took part in a 
second (see Table 3.4). In all,* 38.1 percent participated in more than 
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NEW JERSEY 

PERCENT INVOLVED IN SPECIFIED ACTIVITIES 
WITHIN TWELVE MONTHS OF RANDOM ASSIGNMENT, BY RESEARCH GROUP 
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TABLE 3.3 ( con t i nued ) 



SOURCE: MDRC calculations from New Jersey ESARS, New Jersey WIN 
Grant Diversion Project On Board Summary Reports and New Jersey JTPA 
Automated Report ing System. 

NOTES: Activity measures are calculated as a percentage of the 
total number of persons in the indicated research group. The twelve-month 
follow-up period begins at the point of random assignment. 

Active is defined as attendance at any WIN or JTPA component 
or employment in an OJT position for at least one day. 

A chi-square test was applied to differences between 
research groups. Statistical significance levels are indicated os: * = 10 
percent; ** = 5 percent; *** = 1 percent. 



a 

WIN components include Job Search, WIN Referrals to 
Training, work Experience and OJT Employment. 

b 

Non-WIN Institutional Training Includes WIN Referrals to 

J TPA. 

C Rates include entry into OJT employment as well as entry 
Into unsubsldized jobs that was reported to program staff and recorded in 
ESARS. These data were not used to measure employment impacts elsewhere in 
the report. 
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TABLE 3.4 

NEW J ERSE Y 

PARTICIPATION PATTERNS 
WITHIN TWELVE MONTHS OF RANDOM ASSIGNMENT, 
BY RESEARCH GROUP 



Act i v i ty Meos ure 


Expe r imenta l s 


Control s 


Active in: 






Job Search Onl y 


29.1% 


48.4% 


Tra i ni ng Only 


3.3 


5.8 


Wor k Exper i ence On 1 y 


0.2 


0.6 


OJT Only 


13.2 


0.0 


Job Search and Training 


6.9 


1 1.3 


Job Search and work 






Exper i ence 


2.2 


4.5 


J ob Sea r ch and OJ T 


15.6 


0 . 0 


Tra i ni ng and Work 






Expe r 1 enc 6 


0.2 


0 . 4 


Tra i ni ng and OJ T 


3.9 


0.0 


Work Py nAr i AnfJt nnrt HIT 


n a 

U . 0 


U . U 


Job Search. Training and 






Work Experience 


2.2 


2.1 


Job Search, work E^per- 






i ence and OJ T 


0.6 


0.0 


Job Search* Training 






and OJ T 


4.9 


0.0 


Training, work Experience 






and OJ T 


0.2 


0.0 


A) | Four Act ivi ties 


0.8 

* 


0.0 


Never Act i ve 


16.1 


27.0 


Total 


100.0 


100. 1 


Sampi e Size 


508 


486 



SOURCE: MDRC calculations from New Jersey ESARS, New Jersey 
WIN Grant Diversion Project On Board Summary Reports and New Jersey 
JTPa Automated Reporting System. 
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TABLE 3.4 (continued) 



NOTES: Activity measures are calculated as a percentage of 
the total number of persons in the indicated research group. The 
twelve-month follow-up period begins at the point of random 
assi gnroen t . 



r ound i ng . 



Distributions may not add to 100.0 percent due to 



Active is defined as attendance at any WIN or JTPA 
component or employment in an OJ T position for at least one day. 



activities only. 



Training includes WIN referrals to training and all 
'or Sccrci",, Work Z*yvt ieuu unu uj T rerer to win 
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one activity. A third of experimentals combined job search with one or 
more additional activities, including 21.9 percent who combined job search 
and OJT employment. Only 13.2 percent of experimentals worked in OJT jobs 
and did not participate in another activity. These experimentals may have 
been more job-ready and less in need of the full range of services. Those 
not employed in OJT positions were also likely to take part in multiple 
activities. The activity pattern for experimentals in the early sample 
resembles that displayed by the full sample, except that OJT employees in 
the early sample were somewhat more likely to have participated in addition- 
al training (see Appendix Table C. 4). 

A. WIN and JTPA Activities cf Experiment als in OJT Positions 
It was expected that those in OJT employment would be less likely to 
use alternative services. A comparison of participation rates of OJT 
employees and other experimentals shews this to be true for WIN activities 
but not for JTPA. Somewhat unexpectedly, the experimentals in OJT posi- 
tions were more likely to participate in a JTPA activity, especially voca- 
tional training. Referral from their job developers and their established 
•job readiness* may have helped these experimentals get into JTPA acti- 
vities. Experimentals in OJT positions most commonly combined their OJT 
with job search activities, although they also had substantial use of 
additional WIN or JTPA training. 

The use of alternative WIN and JTPA services by those in OJT positions 
can be further explored by looking at the timing of these activities in 
relation to the start of OJT employment. If the activity took place before 
OJT employment, it suggests that the experimentals were referred to these 
components to increase their job-readiness* and improve their chances of 
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being hired by an OJT employer. T f the activity took plc.ce after the OJT 
job began, it may have been necessary to help the experimentals keep their 
jobs, obtain better jobs, or find another job if they quit their OJT jobs 
or were fired. Most experimentals in OJT positions using alternative 
services did so before their OJT job began, receiving additional work 
preparation following randan assignment. However, there was also notable 
use of individual job search (41 people) and JTPA-sponsor ed vocational 
training (15 people) after the OJT job ended. 

B * Employment and Deregistration of Experimentals 

Sixty-five percent of experimentals found employment within 12 months 
of their random assignment, according to the WIN tracking system (see Table 
j. 3). CJT es.ploys.er,;: is included ir* this ^.ploy^^t iate This high 
employment rate indicates that experimentals not in OJT positions were also 
getting unsubsidized jobs. 

A fairly high percentage of experimentals (42.5 percent) were deregis- 
tered within 12 months of follow-up. Only 5.5 percent of experimentals (28 
individuals) were sanctioned. Of these, 21 individuals were not employed 
ir. an OJT job. The results for the full sample were very similar (see 
Appendix Table C. 4). 

c * Participation of Controls in WIN and JTPA Activicies 
As emphasized, this evaluation compares two program streams: regular 
WIN and JTPA services plus eligibility for an OJT position versus regular 
WIN and JTPA services alone. The activities of the control g<roup provide a 
measure of services likely to have been received by experimentals without 
the OJT program. 

Control group members were eligible for all alternative WIN services 

* 
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as well as JTPA services. Controls were treated like other WIN recipients 
who shewed interest in participating in employment-related activities. 
Staff assessed their employment needs, provided counseling and job leads, 
referred them to other training or education providers, and arranged for 
support services. Some job developers who assessed both experiroentals and 
controls also indicated that they steered premising members of the control 
group to a JTPA training program or referred them to the regular ES job 
developer. 

Rates of participation in employment -related activities of controls, 
as reflected in participation records from the automated tracking systems 
of WIN and JTPA, are presented in Table 3.3. Most strikingly, the control 
group was very highly served. This participation rate is considerably 
higher than the participation rates of the control groups in other stat< 
welfare employment initiatives evaluated by MDRC — higher indeed than the 
participation rates of experimentals in some of these demonstrations.*^ 
The New Jersey OJT program recruitment process largely explains the high 
rate of control services. As discussed in Chapter II, the program 
enrollees were recruited from participants in existing services, especially 
Job Club, in the regular WIN system. 

Seventy-three percent of controls were active in some employment- 
related activity during the 12-raonth follow-up period (see Table 3.3). 
More than 70 percent were active in at least one WIN component. Controls 
were especially 1 ikoly to take part in job search activities (66. 3 
percent). A much smaller percentage (7.6 percent) participated in WIN- 
sponsored work experience. In addition, 17.1 percent of controls took part 
in JTPA-sponsored activities, mostly vocational training (57 controls took 
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part in this service; only 14 were placed in a JTPA-sponsored OJT job). 
The percentage of controls in activities in the early sample is comparable 
to those active in the full sample, although the full sample had a slightly 
higher rate of participation in work experience (8.5 percent). (See 
Appendix Table C. 3. ) 

The controls could also participate in more than one activity within 
the follow-up period. Table 3.4 reveals, nonetheless, that they generally 
participated only in job search (48.4 percent). An additional 17.9 percent 
combined job search with training, work experience, or both. Only a few 
controls participated in training or work experience without job search. 
Their lack of use of additional services may be due to their ability to 
find employment through job search activities. The control group partici- 
pation patterns were comparable for the full sample (see Appendix Tatole 
C.4). 

D. Employment and Deregistration of Controls 

Almost 47 percent of controls were employed within 12 months of 
follow-up, according to WIN records, and 38.5 percent were deregistered 
(see Table 3.3). Only 4.5 percent were deregistered as the result of 
sanctioning. The full sample results on employment and deregistrations 
were very similar, except for a slightly higher rate of sanctioning (6 
percent). (See Appendix Table C. 3. ) 

E. Employment and Training Activities of 
Experimental and Controls Compared 

Adding OJT employment to other WIN and JTPA services increased the 

likelihood of participation in sane employment-related activity. Five out 

of six experiraentals were employed in an OJT job or took part in another 

» 
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WIN or JTPA activity within 12 months of random assignment. The control 
group average (73 percent) was also high, but was still 11 percentage 
points below the rate for exper imentals. In addition to OJT employment, 
experimentals were more likely to participate in JTPA activities, whereas 
controls were more likely to participate in job search and work experience. 

A significantly higher percentage of experimentals entered employment 
within 12 months of follow-up (65.4 percent) compared to 46.7 percent for 
controls. A higher percentage of experimentals (42.5 percent) were also 
deregistered compared to controls (38.5 percent). (This is not sta- 
tistically significant, however.) 

Participation in employment-related activities most likely affected 
the subsequent employment and welfare behavior of both experimentals and 
controls. (These are examined in Chapter IV. ) In interpreting the differ- 
ences in employment, earnings, and welfare receipt between the two research 
groups, it is important to keep in mind the findings of this chapter: (1) 
most experimentals did not work in CUT jobs, but n?jrly all experimentals 
participated in scrae employment-related activity; (2) controls, like experi- 
mentals, rere very highly served; and (3) both groups ir.ade extensive use of 
job searcn and training services. 
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CHAPTER IV 



PROGRAM IMPACTS 
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I« Introduction and Summary 

A. Key Research Questions and Research Issues 

New Jersey's on-the« job-training program sought to increase employment 
and earnings and reduce welfare dependency. This chapter reports on the 
effectiveness of the program in attaining these goals, both in the short 
term, when many experimental s were in OJT positions, and in the longer 
term, after the vast majority of those placed in on-the- job-training 
positions were no longer receiving subsidies. 

To determine the effect of having been assigned to any program, two 
basic questions must be answered. First, on average, what happened to 
those who were assigned to the program? Second, on average, what would 
have happened to them had they not been assigned to the program? The 
effect, or "impact," of having been assigned to a program is the difference 
between the^e two average outcomes. 

If sample members become "experimentals" or "controls" completely at 
random, there are no systematic measured or unmeasured differences between 
the two groups before program treatment. As was shown in Chapter II, 
measured differences in averege characteristics between experimentals and 
controls for this evaluation were slight. 1 Thus, average outcomes among 
controls provide accurate benchmarks for what average outcomes would have 
been among experimentals had the treatment not been available to them, and 
differences in average outcomes between experimentals and controls measure 



the program's effects. Even without help from the program, most sample 
members found employment and/or left the AFDC rolls within a fairly short 
time. Average outcomes among controls document his background level of 
caseload turnover. The impacts reported here do not credit the program for 
the increased employment and reduced AFDC dependency that would have 
occurred even in its absence. 

Several considerations should be kept in mind when interpreting these 
results. First, the program impacts presented here are impacts of assign- 
ment to eligibility for one stream of services versus assignment to 
eligibility for another stream of services. Controls ^ould receive JTPA 
and regular WIN services; exper imentals were eligible both for these 
services and for on-the-job training. Thus, the results are incremental 
impacts, measuring the effect of adding on-the-job training to the mix of 
services already available for the adult welfare population in New Jersey. 

Second, not everyone who was assigned to experimental status parti- 
cipated in on-the-job training: Only 369 of the «14 experiraentals in the 
short-term impact sample, and only 207 of the 508 experiraentals in the 
early sample, were placed in subsidized jobs. However, everyone assigned 
to experimental status was included when calculating impacts of assign- 
ment to on-the-job training. Thus, impact estimates average net outcomes 
for all exper imentals, including the large share of experimental who were 
not placed in on-the- job-training posit ions. Therefore, impacts measure 

not the impact of placement in on-the-job-tiaining positions, but rather of 

2 

assignment to the group eligible for on-the-job training. 

Third, because of data limitations, the same samnle could not be used 
for all impact analyses. Earnings outcomes for the first two quarters were 




not available except for the short-term Impact sample of 1,604 assigned 
from April 1985 through June 1986 (see Chapter II, Table 2,5). Because 
earnings beyond quarter four were available only for members of the early 
sample already described in Chapter in, that sample had to be used to 
analyze longer-term, post-program impacts. All tables in this chapter have 
been labeled either •short-term impact sample* or • early sample- to 
distinguish the two groups. There is some reason to believe that had it 
been possible to observe outcomes for the full sample for all periods, 
full-sample impacts would be somewhat smaller than those for the short-term 
sample, but somewhat larger than those for the early sample. 

Fourth, AFDC data measure impacts on people, not on government out- 
lays. As explained in Chapter II, the impact data do not include welfaie 
funds diverted to wage subsidies. These data capture only the AFDC grant 
amounts that individuals rprPivprf dirori-iv /tho uni^^^ MM *-v<- 
government budget are explored in Chapter V. ) 

Finally, earnings data include earnings from both on-the-job-training 
positions and unsubsidized employment. Employment data include employment 
in both subsidized and unsubsidized positions. Thus, any measurable short- 
term impacts are bought in part with government subsidy dollars transferred 
to participating employers. Longer-term outcomes, after the vast majority 
of on-the-job-training contracts had ended, are almost entirely free of 
such subsidized earnings and employment. Training contract starting times 
and durations varied considerably. However, the approximate dividing line 
between predominantly in-program and post-program periods was drawn at the 
end of the fourth quarter. More than 94 percent of contracts had ended by 
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then, and all but two of the remainder had ended by qi arter six. (See 
ible 4.1. ) 

B. Summary of Overall Impacts 

The on-the-job-training prograir had sustained impacts on earnings and 
AFDC income, both during the predominantly in-program period ending in 
quarter four, and after the vast raejority of participants had left the 
program. Impacts on employment rates and on rates of receipt of AFDC 
tended to weaken by the predominantly post-program period. 

The program led to more work and higher earnings for members of the 
short-term impact sample during the first year after enrollment. Impacts 
on employment lates were substantial in quarters one and two, reaching 15.3 
and 13,1 percentage points, respectively, but then fell off sharply in 
quarters three and four. Impacts on earnings peaked in quarter two, dipped 
during quarter three, but improved slightly in quarter four. 

Reflecting these earnings impacts, there were notable reductions in 
receipt of AFDC and amounts of AFDC income f^om the second through fifth 
quarters. The timing of these reductions partly reflects lags due to 
retrospective budgeting of AFDC grants in New Jersey. During quarter four, 
5.6 percentage points fewer experimental than controls were receiving AFDC 
payments. During the first year of follcw-up, experimentals averaged 
$3,104 in AFDC income, compared to $3,369 for controls. The difference, 
$265, amounts to a savings of 8 percent. 

For the early sample o£ 904 assignee from October 1984 through 
September 1985, there was earnings f oliow-up f ran quarters three through 
seven, and AFDC follow-up from quarters one through eight. Attention was 
focused on impacts from quarter five onward because that v*as a 
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TAE.E 4. 1 



NEW JERSEY 

DISTRIBUTION Or EXPER I MENTALS EMPLOYED IN OJ T POSITIONS. 
BY PERIOD WHEN LAST OJ T JOB ENDED 



(SHORT-Ti 


ERM 


IMr *CT 


SAMPLE) 




Period when Lost Employed in 








Cumul at I ve 


Subs: dized OJ T Posi ti on 




Number 


Percent 


Percent 


Quarter of Random Assignment 




105 


28.5 


28.5 


Quarter 2 




152 


41.2 


69.6 


Quarter 3 




63 


17.1 


86. 7 


Quarter 4 




29 


7.0 


94.6 


Quarter 5 




1 2 


3.3 


97.8 


Quarter 6 




6 


1.6 


99.5 


Quarter 7 




2 


0.5 


100.0 


Samp; e Size 




369 


'00.0 





SOURCE : MDRC calculations from New Jersey WIN Grant Diversion 
Project On Board Summary Reports. 

NOTES: 3'9 af the 814 e/per i men t a I s randomly assigned between April 
1 985 and June 1 986 were employed in at least ane OJ 7 position. 

Quarterly percentages may nat sum to cumulative percentages 
due to rounding. 
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predominately pojt-program period. In all quarters, impacts on earnings 
were favorable, and in all quarters except the first, welfare income was 
reduced. Earnings impacts peaked in quarters five and six; reductions in 
AFDC income fell off after quarter six. However, there were no strong 
impacts on rates of employment, which suggests that the earnings impacts 
came not from more iobs for experimental, but from better jobs. Over 
quarters five through seven, the program increased earnings by $468, almost 
15 percent of the control average of $3,159 in earnings. Over quarters 
five through eight, the programs reduced AFDC income by $238, almost 11 
percent of the control average of $2,184 in AFDC income. The program also 
reduced the number of raonuhs receiving AFDC during quarters five through 
eight; this impact was 0.5 months on a control base of 5.9 months. 

II. Impacts for i*ie Short-term Impact Sample 

The success of a wage subsidy program in increasing participants' 
in-program employment and earnings depends on the relative strengths of 
four program effects. First, subsidizing participants' salaries ought to 
make it less expensive for employers to hire them instead of other workers. 
Second, preliminary screening by the job developer could give employers 
more information about program participants than about other job appli- 
cants, thus reducing the risk that participants would be unsatisfactory 
employees, and moving them ahead in tfc? queue for jobs. Third, Burtless 
(1984) ai*d others h<ive pointed out that identifying participants to 
employers as disadvantaged could have a "stigma effect" that might reduce 
their employment rate. (However, this effect might be smaller in an OJT 
program like New Jersey's, where job developers contracted with employers 




to place welfare recipients, than it would be in a program like the one 
studied by Burtless, in which welfare recipients were given wage subsidy 
vouchers and told to conduct their own joo search. ) Finally, there could 
also be a "screening effect": To the extent that employers are able to 
screen participants even further and hire only those they would have hired 
without the subsidy, state funds spent on subsidies would merely provide 
windfalls to employers and have no effect on employment rates or earnings. 
If the subsidy and information effects outweigh the stigma and screening 
effects, assignment to on-the-job training should lead to higher in-program 
employment rates and earnings. 

At placement, the total amount of the AFDC grant is frozen, but the 
portion paid to the participant is reduced to reflect income due to 
earnings. Thus, the amount of AFDC income a subsidized worker actually 
receives should fall, although rates of welfare receipt may not fall as 
sharply. Since those placed in subsidized jobs may keep part of their AFDC 
grants for a time and since employers supplement the grants with wages, 
total income for participants should rise during the in-program period. 

The overall in-piogram effect of assignment to on-the-job training is 
composed of its effect * both those who are and are not placed in sub- 
sidized jobs. Even it.:v.;'i * overall effect may be positive, the effect 

4 

on those not placed raisM 1 - >' negative. Same program participants might be 
caught tor a vhile betw-in job developers raising their wage expectations 
and employers screening them out when positions become available. Eventual- 
ly, those who are not placed ±n subsidized jobs, but who can find less 
desirable jobs on their own, might do at least as well in the labor market 
as they would have without the on- the- job-training program. However, for a 
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time, their employment rates and earnings might be depressed below what 
they would have been without the program. 
A. Short-term Labor Market Impacts 

For the 1,604 members of the short-term impact sample assigned from 
April 1985 through June 1986, Table 4.2 and Figure 4.1 show substantial 
emp] oyment-rate impacts. 5 The program resulted in a 7. 4 percentage point 
increase in the proportion of experimentals ever employed during the first 
year after random assignment. This impact vas statistically significant.** 
Even without the program, the cumulative rate of employment during this 
period would have been extremely high with almost three-fourths of controls 
finding employment within the first year after random assignment. 

Quarter-by-quarter impacts were sometimes much larger than the 

cumulative impact, but they were not stable. Kates of employment were 15.3 

percentage points higher for experimentals in the first quarter, on a 

control base of 40.1 percent, and 13.1 points higher in the second quarter, 

7 

on a control base of 48.7 percent. However, employment-rate impacts 
dropped steeply in quarter three. This drop seems due mainly to a decline 
in the experimentals' employment rate to 55.3 percent, just below where it 
started in quarter one. The end of OJT employment for a substantial number 
of experimentals in the second quarter (according to Table 4.1, more than 
40 percent of them) may explain this decline. During this same period, the 
control employment ra\e rose fairly steadily, and had come within 2.5 
percentage points of the experimental rate by quarter four. 

Both experimentals and controls apparently moved in and out of employ- 
ment, as reflected by cumulative employment rates that were substantially 
higher than the quarterly rates. Experimentals were also employed during 
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TABLE 4.2 



NEW J ERSE Y 

IMPACTS ON EMPLOYMENT RATES ANO EARNINGS 
(SHORT-TERM IMPACT SAMPLE} 



Outcome and Fo l low-Up Period 


Experimental s 


Cont roi s 


Difference 




p 


Ever Employed* uuarters i-4 \\) 


on t 


7 1 7 
/ 4 . / 


7 


.4»** 


A 

u • 


AAA 

u uu 


Averoge Number of Quorters with 














Em pi oyment , Quo r te rs 1-4 


2.28 


1.93 


0 


.35*** 


0. 


000 


Ever Empl oyed (X) 














Quorter of Random Assignment 


C C A 

3 3.4 


4 U . 1 


I r 
1 3 


"J * * * 


A 

U • 


AAA 

u UU 


Quorter 2 


61.8 


48.7 


13 


. 1*** 


0. 


000 


Qiinr fir 1 
WUUl 181 J 


9 9 « J 


3 U < O 


4 


.5* 


0. 


066 


Quorter 4 


55.8 


53.3 


2 


. 5 


0. 


310 


Averoge Total Earnings* 














Quarters 1-4 (*)° 


3500.06 


2865. 78 


634 


.28*** 


0. 


002 


Averoge Quarterly Earnings ($)° 














Quarter af Random Assignment 


476.55 


357.43 


119 


.12*** 


0. 


006 


Quorter 2 


916.73 


699.08 


117 


.66*** 


0. 


000 


Quorter 3 


1007 .89 


868.64 


13? 


.25** 


0. 


036 


Quorter 4 


1098.89 


940.63 


158 


.26** 


0. 


024 


Sample Size 


814 


790 











SOURCE: M0RC calculations from New Jersey Unemployment Insurance earnings 
records. 

NOTES: Experimental and control group averages are regression-adjusted using 
ordinary least squares* controlling for pre-random assignment characteristics af 
sample members (see Appendix Table 0.2). There may be discrepancies in sums and 
differences due to rounding. 

A two-toiled t-test was applied to each difference between experi- 
mental and control groups. The column labeled "p - is the statistical significance 
level af the difference itween experimental and control overages. Statistical 
significance levels are idlcated as: * * 10 percent; ** * 5 percent; *** ■ 1 
percent. 

o 

These calculations include values of zero for sample members not 

empl oyed. 
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FIGURE 4.1 
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more quarters than controls, as indicated in Table 4.2. Experimental had 
employment in OJT or unsubsidized jobs during an average of 2.28 quarters; 
the statistically significant impact of 0.35 quarters was more than 18 
percent of the control base of 1. 93 quarters. 
B. Short-term Impacts on Earnings 
Table 4.2 and Figure 4.1 shew that impacts on earnings were more 
stable than impacts on employment rates. Adjusted earnings impacts peaked 
at $218 in quarter two, and were then maintained at a lower level. In each 
of the first two quarters, the earnings impact was more than 30 percent of 
its control mean. Although the impact fell in quarter three, and recovered 
only slightly in quarter four, it was still 16 percent above its control 
mean in both those quarters. Earnings impacts were statistically signifi- 
cant during each of the first four quarters. Over the first year, experi- 
mental earned $634 — or 22.1 percent ~ more than the control average of 
$2,866. 

Thus far, results show clearly favorable effects on both employment 
and earnings outcomes, but reveal some differences in the time profiles of 
impacts. While employment-rate effects started out large and quickly 
declined, earnings impacts seemed to be sustained. This gives rise to two 
questions: First, does the timing of subsidized placements also explain 
the timing of employment and earnings impacts? Second, did the program 
move experimentals into their first post-assignment jobs more quickly than 
controls? The answers to both these questions seem to be yes. 8 

There are three fundamental sources for the $634 cumulative earnings 
impact: (1) a 7.4 percentage point advantage for experimentals in the 
proportion ever employed during the first year after random assignment; 



(2) an advantage for employed experimental in the number of quarters with 
employment; and (3) higher average earnings per quarter among employed 
experimentals. .Ml three sources are important, but Appendix Table D. 6 
shows that, over the first four quarters as a whole, the first source is 
much more important than the third. More than half of the cumulative earn- 
ings impact during the first year after random assignment was due to the 
impact on the proportion of those ever employed, while less than 10 percent 
was due to higher average earnings among those ever employed. More than a 
third of the earnings impact was due to the increase in number of quarters 
with employment. This empirical evidence clearly shews that the program 
moved experimentals into employment; that it apparently moved them into 
jobs more quickly; and that it moved them into jobs that paid more per 
quarter than they would have earned otherwise. More pay per quarter with 
employment could be the result of higher wages per hour, more hours of work 
per week, or more weeks of work per quarter. 

C. Short-term Impacts on Welfare Dependency 

Table 4.3 and Figure 4,2 show that virtually every sample member 
received AFDC at some point during the follow-up. Further, there was 
essentially no impact on receipt of AFDC during quarters one and two. 
However, the impact was favorable in quarter three, and by quarter four, 
5.6 percentage points fewer experimentals received AFDC* 

Table 4.3 shows that impacts on amounts of AFDC income were also j avor- 
able, but welfare savings peaked at $110 in quarter three. In the fourth 
quarter, welfare savings amounted to $82, 12.1 percent of the control mean 
of $675. For the four-quarter in-program period as a whole, 
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TABLE 4.3 



NEW JERSEY 

IMPACTS ON RATES OF AFOC RECEIPT AND AFDC PAYMENTS 
(SHORT-TERM IMPACT SAMPLE) 



Outcome and Pol low-Up Period 


Expe r I menta I s 


Control s 


Oi f f erence 


P 


Ever Received AFOC, 










Quarters 1-4 (X) 


V7.6 


97.2 


0.4 


0.613 


Average Number of Months 










Receiving AFOC, Quarters 1-4° 


8.5) 


9.13 


-0.63*** 


0.000 


Ever Received AFDC (X) 








- 


Quarter of Random Assignment 


96.6 


95. 2 


1 .4 


0. 1 46 


Quarter 2 


89.7 


92.0 


-2.2 


0.117 


Quarter 3 


73.3 


78.4 


-5. 1** 


0.013 


Quarter 4 


62.1 


67.8 


-5.6** 


0.015 


Quarter 5 


54.7 


60. 7 


-5.9** 


0.01 2 


Average Total AFOC Payments, 










Quarters 1-4 ($)° 


3104.51 


3369.28 


-264.77*** 


0.00G 


Average AFOC Payments ($)° 










Quarter of Random Assignment 


1007.43 


996.50 


10.93 


0.482 


Quarter 2 


838.75 


923.00 


-84.25*** 


0.000 


Quarter 3 


664.94 


774.55 


-109.61*** 


0.000 


Quarter 4 


593. 39 


675.23 


-81 .84*** 


0.001 


Quarter 5 


533.55 


604.60 


-71.05*** 


0.007 


Sampl e S ize 


814 


790 







SOURCE: MDRC calculations from New Jersey AFOC records. 

NOTES: Experimental and control group averages are regression-adjusted 
using ordinary least squares, controlling for pre-random assignment character- 
istics of sample members (see Appendix Table 0.2). There may be discrepan- 
cies in sums and differences due to rounding. 

A two-tailed t-test was applied to each difference between 
experimental and control groups. The column labeled 'p' is the statistical 
significance level of the difference between experimental and control averages. 
Statistical significance levels are indicated as: * = 10 percent; ** = 5 
percent; *** = i percent. 

a 

These calculations include values af zero for sample members not 

receiving AFDC. 
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FIGURE 4.2 
NEW JERSEY 



TRENDS IN AFDC RECEPT AND AFDC INCOME 
(SHORT-TERM WPACT SAMPLE) 
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welfare savings amounted to $265, 7.9 percent of the control mean of 
$3,369. 



The sura of AFDC income and earnings ior a period is the best available 
measure of the total cash income available during that period. During the 
predominantly in-program period from quarter one through quarter four, 
Table 4.4 shows that the average control had $6,235 in such total measured 



Impacts on this outcome started out fairly large, reflecting the immediate 
earnings impacts and slcwer-soarting welfare reductions already discussed. 
In both quarter one and quarter two, impacts on total measured income were 
above $130 and were statistically significant. When earnings impacts 
declined and welfare grants began to reflect increased earnings in quarter 
three, the two sources of income largely offset one another, yielding a 
quarter three impact on measured income of only $30, less than 2 percent of 
the control mean. However, these impacts appeared to improve in the fourth 
quarter. For the in-program period as a whole, experimental came out 
moderately ahead. The impact on total measured income was $370, 5.9 
percent of the control mean of $6,235. 

IM - Longer-term Impacts for the Early Sample 

For the short-term impact sample of 1,604 just discussed, there is 
little or no follow-up beyond the in-program period ending in quarter four. 
However, a partially overlapping early sample of 994 has earnings follow-up 
for quarters three through seven, and AFDC follow-up for quarters one 
through eight. Table 4.5 shews that, as with the short-term impact sampJe, 



D. 



Short-term Impacts on Total Measured Income 



income. After quarter one, control income stayed above $1,600 per quarter. 
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TABLE 4.4 



NtW J ERSEY 

IMPACTS ON TOTAL MEASURED INCOME 
(SHORT-TERM IMPACT SAMPLE) 



Outcome and Fallaw-Up Period 


Experimental s 


Cant ral s 


Difference 




p 


Average Total Measured 












income* Quarters 1-4 


$6604.57 


$6235.06 


$369.5;** 


0. 


046 


Average Total Measured 












1 ncome 












Quarter of Random Assignment 


1483.98 


1353.93 


130.05*** 


0. 


003 


Quarter 2 


1755.48 


1622.08 


133.40** 


0. 


017 


Quorter 3 


1672.83 


1643. 19 


29. 6* 


0. 


616 


Quarter 4 


1692.28 


1615.86 


76.42 


0. 


224 


Sample Size 


814 


790 









SOURCE: MDRL calculations from New Jersey AFDC and Unemployment 
Insurance earnings records. 

NOTES: Total measured income is defined as the sum af AFDC income 
and earnings. 

These calculations include values of zero for sample members 
with no measured income. 

Experimental and control group averages are regression- 
adjusted using ordinary least squares* controlling far pre-random assign- 
ment characteristics af sample members (see Appendix Table D.2). There may 
be discrepancies in sums and differences due ta rounding. 

A two-tailed t-test was applied ta each difference between 
experimental and control groups. The column labeled a p a is the statistical 
significance level of the difference between experimental and control 
overages. Statistics! significance levels ore indicated os. * = 10 
percent; ** = 5 percent; *** = 1 percent. 
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TABLE 4.5 



NEW JERSEY 

DISTRIBUTION OF EXPER I MEN TALS EMPLOYED IN OJ T POSITIONS* 
BY PERIOO WHEN LAST OJ T JOB ENOEO 
(EARLY SAMPLE) 



Period when Lost Employed in 
Subsidized OJ T Position 


Number 


Percent 


Cumul a tive 
Percent 


Quarter of Random Assignment 


48 


23.2 


23.2 


Quorter 2 


79 


38.2 


61.4 


Quarter 3 


40 


19.3 


80. 7 


Quorter 4 


22 


10.6 


91.3 


Quarter 5 


7 


3.4 


94.7 


Quorter 6 


8 


3.9 


98.6 


Quarter 7 


2 


1.0 


99.5 


Quorter 8 


1 


0.5 


100.0 


Sample Size 


207 


100.0 





SOURCE: MDRC calculations from New Jersey WIN Grant Ojversian 
Project On Baord Summary Reports. 

NOTES: 207 af the 508 exper imentol s randomly assigned between 
October 1984 and September 1985 were employed in at ieost one OJ T position. 

Quarterly percentages may nat sum to cumulative percentages 
due ta rounding. 
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most of the early sample had completed any on-the-job-training contracts by 
the beginning of the fifth quarter. Thus, to measure predominantly post- 
program outcomes, the rest of this chapter concentrates on outcomes from 
quarter five onward lor the early sample of 994. 

Continued effects of subsidized on-the-job- training placement on 
employment and earnings may ste.. from 'rollovers' into permanent jobs with 
the subsidized employer and from the effects of training on earnings. Some 
of tne skills imparted by the subsidized employer may also be valuable to 
other potential employers, thus improving post-program employment prospects 
and raising post-program earnings. 

k. Longer-term Labor Market Impacts 

Table 4.6 and Figure 4.3 show a mixed picture for post-program employ- 
ment-rate impacts. The early sample appears to have impacts in quarters 
three and four weaker than those present for the short-term impact sample. 
Separate impacts on employment rates are reported for quarters three 
through seven, and an additional imoact is reported for the mostly post- 
program quarters five through seven taken together. The program caused a 
3.2 percentage point increase in the proportion of experiraentals employed 
at any time during quarters five through seven. Most of this cumulative 
Impact appears due to the 5.3 percentage point impact In quarter five, 
which is the result of a temporary dip in employment among rontrols. The 
Impact disappeared in quarters si* and seven. Even without the program, 
the cumulative rate of employment during this periou would have amounted to 
about two-thirds. According to the quarter-by-quarter figures, experi- 
raentals* and controls 1 rates of employ >nt seem to drift upward slightly 
and to stabilize around 56 or 57 percent. During the predominantly post- 



TABLE 4.6 
NEW JERSEY 

IMPACTS ON EMPLOYMENT RATES ANO EARNINGS 
(EARLY SAMPLE) 



Ant fflnd n r% ri C a 1 1 nw > II n Pfl r 1 n H 

out ion c una rui i or up rerioa 


c A p 6 l 1 Hi c 1 1 T 0 1 5 


C n n ♦ r n ( c 
L 0 It T 1 0 1 9 


uiTTerence 


P 


Ever Employed* Quarters 5-7 (%) 


70. ] 


66.9 


3.2 


0.285 


Averoge Number of Quarters with 










Employment* Quarters 5-7 


1.69 


1 .66 


0.03 


0.686 


Ever Em pi oyed (X) 










Quorter 3 


55.0 


51.5 


3.5 


0.269 


Quorter 4 


54.8 


55.2 


-0.4 


0.896 


0 uo r t e r S 


5 A 0 


J 1 . w 


5 3 * 

4 * «J 


0 095 


Quorter 6 


56.4 


56.7 


-0.2 


0.939 


Q uor te r 7 


56. 1 


57.8 


-1.7 


0. 584 


Averoge Totol Earnings* 










Quarters 5-7 ($)° 


3627.43 


3159. 10 


468.32* 


0.060 


Averoge Quorterly Earnings ($)° 










Quarter 3 


881 .40 


841 . 24 


40. 1 5 


0.590 


Quarter 4 


974.33 


939.52 


34.81 


0.663 


Quorter 5 


1 155.09 


981 .25 


173.83** 


0.048 


Quorter 6 


1259.79 


1087.82 


171.97* 


0.061 


Quorter 7 


1212.55 


1 090.03 


122.52 


0. 177 


Sample Size 


50b 


486 







SOURCE: M0RC calculations from New Jersey Unemployment Insurance earnings 
records. 

NOTES: Experimental ond control group overages are regressian-ad j usted using 
ordinory leost squares* controlling for pre-rondom assignment characteristics of 
sample members (see Appendix Table 0.2). There may be discrepancies in sums and 
differences due to rounding. 

No earnings doto were available for quarters 1 or 2 for those randomly 
assigned between October 1 984 one! Oecember 1 984 ond no earnings doto were available 
far quorter 1 for those randomly assigned between January 1985 ond March 1985. 
Quorters 1 ond 2 were therefore excluded. 

A two-tolled t-test wos applied to each difference between experi- 
mental ond control groups. The column labeled 'p' is the statistical significance 
level of the difference between experimental ond control overages. Statistical 
• significance levels ore Indicated os: * = 10 percent; ** = 5 percent; *** * 1 
percent. 

a * 
These calculations include volues of zero for sample members not 

employed. 
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FIGURE 4.3 
NEW JERSEY 
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program period, experimental were not employed significantly longer than 
controls. Table 4.6 shows an impact on number of quarters with employment 
cf only 0. 03, on a control base of 1.66 quarters, during quarters five 
through seven. 

Table 4.6 and Figure 4.3 show that post-program impacts were more 
consistent for earnings than for employment. Earnings impacts for the 
early sample were $174 in quarter five, $172 in quarter six, and $123 in 
quarter seven. over the three quarters taken together, turnings impacts 
amounted to $438, about 15 percent of che control base of $3,159. 

As noted earlier, emulative earnings impacts have three sources: 
(1) differences in cumulative rates ever employed; (2) differences in 
number of quarters with employment, if ever employed; and (3) differences 
in average earnings per quarter with employment, if ever employed. The 
proportion ever employed has already been discussed (see Table 4.6). 

The third source is the different levels of earnings for those who 
were employed. If employed experimental hid higher wages or more hours or 
weeks of work than employed controls, average experimental earnings would 
be higher, even if there were no impacts on employment rates and numbers 
of quarters employed. Table 4.7 gives adjusted mean earnings among 
experimental and controls who were employed in each period. As explained 
in Appendix D of Auspos et al. , 1988, differences in these adjusted means 
are not the same as impacts because, to the extent that the program was 
effective, employed exper imentals may differ in pre-assignraent character- 
istics from employed controls. However, a pattern of increased earnings 
for employed exper imentals over the follow-up period — from negative $34 
to positive $288 by quarter seven — seems evident, though statistical 
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TABLE 4.7 



NEW JERSEY 

EMPLOYMENT 'H D EARNINGS OUTCOMES AMONG EMPLOYED SAMPLE MEMBERS 

(EARLY SAMPLE) 



Outcome and Fol 1 aw-Up 


Per i ad 


expo r i wo n i q , •> 


L U II T 1 U 1 « 


Oi f f erence 




n 

r 


Averoge Number 


af Quarters 


w i t h 














Empl ayment, i f 


Ever Empl ayed* 














Quarters 5-7 








L • 4 L 


9 J fl 
L • 'i 0 


-0 


06 


n 


7 A3 


Average Total 


Ear n i ngs 


• i f 


Ever 














Enpl ayed. Quarters 5-7 


(*) 




5180 90 


4723. 1 7 


1(7 
4 3/ 




0. 


1 21 


Ave rage Ear n i ngs. 


















if Ever Employed ($) 


















Quarter 3 








1 A 00 0 4 


16 34 0 7 


-34 


.03 


0. 


7 38 


Quarter 4 








17 7$ 41 


1 7 03 . 1 6 


72 


.24 


0. 


4 97 


Quarter 5 








2022.85 


1 909. 99 


1 1 2 


.86 


0. 


333 


Quarter 6 








2227.43 


1 929.37 


298 


.06*" 


0. 


010 


Quarter 7 








2168.66 


1 880.87 


287 


.78** 


0. 


013 


Sample Size 




















Quarters 5-7 








353 


328 










Qcorter 3 








278 


252 










Quarter 4 








276 


27 1 










Quarter 5 








286 


254 










Quarter 6 








283 


27 9 










Quarter 7 








282 


284 











SOURCE: MDRC calculations from New Jersey Unemployment Insurance 
earnings records. 



du' 



NOTES: Sample members were excluded from calculations far periods 
ig whicn they had na earnings. 



Experimental and control group averages are regression-adjusted 
using ordinary least squares, controlling far pre-random assignment 
characteristics af sample members (see Appendix Table 0.2). There may be 
discrepancies in sums and differences due ta rounding. 

Na earnings data were available far quarters 1 or 2 for those 
randomly assigned between October 1934 and December 1984 and no earnings data 
were available far quarter 1 far those randomly assigned between January 1985 
and March 1985. Quarters 1 and 2 were therefore excluded. 

A two-tailed t-test was applied ta each difference between 
experimental and control groups. The column labeled is the statistical 
significance level af the difference between exper imental and control averages. 
Statistical significance levels are indicated a?: * = 10 percent; ** = 5 
percent; *** = 1 percent. 
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significance was achieved only after quarter five. 

This empirical evidence is consistent with the hypothesis that the 
wage subsidy tended to muve participants into jobs offering more hours of 
work or higher pay than they would have gotten otherwise. Table D. 7 shows 
that the cumulative post-program earnings impact was due overwhelmingly to 
higher earnings for employed exper imentals than for employed controls. 
Among those ever employed, controls actually had more quarters of employ- 
ment than experimentals. Hcwever, the cumulative employment-rate impact 
just about offset this negative effect on earnings of nanber of employed 
quarters, among those who were employed. 

On the whole, the pattern of labor market results supports the theory 
that on-the-job-training placement was responsible for sustained positive 
earnings impacts and for positive employment-rate impacts immediately after 
random assignment, though employment rate.*: for controls soon caught up with 
employment rates for experimentals. It can be argued that the subsidy or 
the placement assistance provided by the program moved its participants 
ahead in the queue for jobs that offered more hours of work or higher pay, 
and that once they obtained such jobs, the* tended to keep them or found 
other jobs fairly quickly. 

B. Longer-term Impacts on welfare Dependency 

Table 4.8 and Figure 4.4 show a cumulative impact on welfare receipt 
of 2.3 percentage points during quarters five through eight, which is 
smaller than the average impact during individual quarters. Starting at 
4.9 percentage points in quarter five, the impact on the welfare rolls 
seems to peak at 6.4 points in quarter six and then to decline to 3.8 
points in quarter seven and to 1.9 points in quarter eight. The indi- 
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TABLE 4.8 



NEW JERSEY 

IMPACTS ON RATES OF AFDC RECEIPT AND AFOC PAYMENTS 
(EARLY SAMPLE) 



Outcome and Follow-Up Period 


Experimental s 


Control s 


Di f f er ence 




p 


Ever Received AFDC {%) 












Quarters 1-8 


98.0 


97.7 


0.3 


0. 


736 


Quarters 5-8 


60.7 


62.9 


-2.3 


0. 


448 


Average Number of Months 












Receiving AFDC 0 












Quarters 1-8 


14.24 


15.06 


-0.81 * 


0. 


098 


Quarters 5-8 


5.41 


5.90 


-0.49 


0. 


132 


Ever Received AFDC [%) 












Quarter of Random Assignment 


97.4 


96.3 


1.1 


0. 


298 


Quarter 2 


93.6 


91.4 


2.2 


0. 


176 


Quarter 3 


76.8 


77.7 


-0.9 


0. 


73f 


Quarter 4 


65.8 


68.6 


-2.8 


0. 


339 


Quarter 5 


56.5 


61.5 


-4.9 


0. 


106 


Quarter 6 


50.6 


57.0 


-6.4** 


0. 


037 


Quarter 7 


47.9 


51.7 


-3.8 


0. 


219 


Quarter 8 


45.7 


*7.5 


-1.9 


0. 


536 


Average Tatal AFDC 












Payments ($) 












Quarters 1-8 


5133*51 


5 5 6 0.99 


-42 7 .48** 


0 . 


02 1 


Quarters 5-8 


1 945.94 


2183.5/ 


-237.63* 


0. 


052 


Average AFDC Payments (S)° 












Quarter af Random Assignment 


998.55 


994.41 


4.13 


0. 


793 


Quarter 2 


883.25 


930.69 


-47.43** 


0. 


041 


Quarter 3 


691 .24 


773.17 


-81.92*** 


0. 


007 


Quarter 4 


614.52 


679.1 5 


-64.63** 


0. 


048 


Quarter 5 


543 . 1 9 


616.80 


-73. 6'** 


0. 


028 


Quarter 6 


493.73 


576.85 


-83.12** 


0. 


013 


Quarter 7 


470.46 


5'3.54 


-43.08 


0. 


200 


Quarter 8 


438. 56 


476.33 


-37.82 


0. 


248 


Sample Size 


508 


486 









SOURCE AND NOTES: See Table 4.3. 
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FIGURE 4.4 
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vidual quarter impacts seem to be mainly a matter of differential timing 
for about the same number of departures from the rolls for experimental as 
for controls. This interpretation is buttressed by the statistically 
significant impact on number of months receiving AFDC, half a month on a 
control base of 5.9 months during quarters five through eight. Apparently r 
the program speeded departure fran the rolls for many who would have left 
the rolls anyway. 

Table 4.8 and Figure 4.4 shew that impacts on amounts of AFDC income 
were also favorable. For the four-quarter post-program period as a whole, 
welfare savings amounted to $238, 10.9 percent of the control mean of 
$2,184. 

C. Longer-term Impacts on Total Measured Income 

During the mostly post-program period fran quarter five through 
quarter seven, Table 4.9 shows that the average control had $4,866 in 
earnings plus AFDC income. Like control income for the short-term impact 
sample, measured income for the early sample of controls stayed near $1,600 
per quarter. Impacts of the program on this outcome were just above $100 
during quarter five, but dipped below $80 in quarter seven. For the 
post-program period as a whole, however, experiment als still came out 
ahead. The impact on total measured income was $269, 5.5 percent of the 
control mean of $4,866. 

IV. General izability of the Findings 

As already noted, because of data limitations, the same sample was not 
used throughout this chapter. The short-term impact sample of 1,604 people 
amounted to about 83 percent of the full, sample of 1,943, and the early 
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TABLE 4.9 



NEW JERSEY 

IMPACTS ON TOTAL MEASUREO INCOME 
(EARLY SAMPLE) 



Outcome and Follow-Up Period 


Exoe r 1 me n t a 1 s 


Co ntrfll s 

mil 1 1 VI 9 


n i ffpronrc 


P 


Averoya Total Measured 










Income, Quarters 5-7 


$51 34.81 


$4866.29 


$268.51 


0.209 


Average Total Measured 










1 ncone 










Quarter 3 


1572.64 


1614.41 


-41.77 


0.519 


Quarter 4 


1588.86 


1618.68 


-29.82 


0.667 


Quarter 5 


1698.27 


1 598.06 


100.22 


0.196 


Quarter 6 


1753.52 


1664.67 


88. 86 


0.272 


Quorter 7 


1683.01 


1603.5/ 


79.44 


0.329 


Sampi e Size 


508 


486 







SOURCE: MORC calculations from New Jersey AFOC and Unemployment 
Insurance earnings records. 

NOTES: Total measured income is defined as the sum of AFOC Income and 
ea rni ngs. 

These calculations include values of zero for sample members 
with no measured income. 

Experimental and control group averages are regression- adjust- 
ed using ordinary least squares, controlling for pre-random assignment 
characteristics of sample members (see Appendix Table 0.2). There may be 
discrepancies in sums and differences due to rounding. 



No earnings data were available for quar. v ers 1 or 2 for those 
randomly assigned between October 1984 and Oecember 1984 and na earnings data 
were available for quarter 1 for those randomly assigned between January 1985 
and March 1985. Quarters 1 and 2 were therefore excluded. 

A two-tailed t-test was applied to each difference between 
experimental and control groups. The column labeled - p - Is the statistical 
significance level af the difference between experimental and control 
averages. Statistical significance levels are Indicated as: • = 10 percent; 
** « 5 percent; ••• » 1 percent. 



ERLC 



•90^ 



130 



sample of 994 for whom longer-term follow-up was available amounted to just 
over half of the full sample. Unfortunately, it is impossible to say 
exactly what short-terra and longer-term impacts would have been had all 



differences in impacts for different samples is county differences in 
on- the- job- training placement rates. For example, compared with the early 
sample, the short-terra irapacc sample includes proportionately more people 
from Hudson and Mercer counties, which achieved higher-than-average rates 
of placement of experiraentals in on-the-job-training positions. More 
subtle differences between samples may also be reflected in differential 
impacts. 

However, the overlap in the outcomes reported for the early sample and 
the outcomes reported for the short-term impact sample has some value for 
analyzing the generalizability of the results to the full sample. In 
general, the early sample seems to have had impacts similar to, but smaller 
than, those for the short-term impact sample. 10 For example, Table 4.6 
shows weaker impacts at the end of the in-program period for the early 
sample than for the larger group whose employment-rate impacts were given 
in Table 4.2. Therefore, the longer-term impacts reported above are 
probably a conservative estimate of the program's longer-terra effect for 
the entire sample. 



data been available for the full sample. 



One apparent source of 
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CHAPTER V 



BENEFIT-COST ANALYSIS 

I- Introduction and Summary of Findings 

This chapter weighs the economic benefits and costs of the two program 
streams evaluated in this report: eligibility for OJT employment as well as 
regular WIN and JTPA services versus eligibility for WIN and JTPA services 
alone. The analysis draws on the findings of previous chapters and also 
utilizes data gathered specifically for estimating benefits 2nd costs. 
Applying techniques developed in other evaluations of social programs, 1 the 
benefit-cost analysis assesses New Jersey's OJT program frcm several 
distinct viewpoints, notably those of the government budget and of the 
welfare recipients accepted into the program and randomly assigned to the 
experimental group. The analysis also considers the effects of the program 
on society in general and on taxpayers. (As explained later, the effect on 
taxpayers is similar but not identical to that on the government budget. ) 2 
Thus, within the constraints of the available data, the analysis estimates 
both the overall cost-effectiveness of the program and the gains and losses 
to the groups it most directly affected. 

This analysis estimates benefits and costs over a five-year period; 
although most costs were incurred when enrollees were still in the program, 
benefits may accrue over a longer time as people formerly dependent on 
welfare continue to work and pay taxes. Therefore, the analysis estimates 
program effects after the data collection period, using alternative assump- 
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tions about how effects calculated with available data might change. In 
this chapter the data collection period is referred to as the observation 
period ? the period between the end of data collection and the end of the 
fifth year after randan assignment is referred to as the projection period , 
(Section ill. D of this chapter explains the procedure for projecting 
effects beyond the observation period. ) 

As in previous chapters, the analysis focuses on the effects of the 
New Jersey OJT Program on members of the early sample. Benefit-cost 
estimates for the later sample, which are more uncertain because only 
short-term earnings and welfare data were available, are included at the 
end of the chapter and in Appendix E and provide context for the early 
sample estimates. 

The principal findings of this analysis are as follows: 

o The average cost of running the OJT component was about $850 
per experimental in the early sample, including wage subsidies 
and administrative costs. Net costs of additional WIN and 
JTPA services were close to zero. 

Job development, matching enrol lees to available OJT jobs, record- 
keeping, and other administrative tasks amounted to nearly 60 percent of 
the funds spent by the OJT program. Payments to OJT employers out of the 
county wage subsidy pools accounted for the rest. The higher cost of OJT 
program administration reflects the fact that money was spent trying to 
place each experimental in an OJT job, even though only 41 percent of early 
sample experiraentals were actually placed. Further, about 45 percent of 
OJT employees left their jobs before the end of their trial employment, 
which limited the money that employers received. As discussed in Chapter 
III, experimentals and controls participated in other WIN and JTPA acti- 
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vities at about the sane rate. Therefore, the costs of these components 
were nearly equal. 

o Over the five-year period (including both observed and project- 
ed estimates), the experimental group, taxpayers, and the 
government budget become better off financially as a result of 
the program. Even within the observation period, experi- 
mentals benefited from the program, while the budget nearly 
broke even. 

As discussed in Chapter IV, exper imentals in the early sample earned, 
on average, $468 more than controls during quarters five through seven. 
When all observed data are included, the experimental-control difference 
rises to $892. This earnings gain (plus an additional $108 in fringe 
benefits) exceeded exper imentals' net losses from higher taxes and lower 
average welfare and Food Stamp payments, resulting in a net gain of $309. 
Exper imentals' higher taxes and savings in transfer payments represent a 
gain to government budgets, which, during the observation period, allowed 
the program to recoup all but $86 of the net cost of providing OJT 
employment and other services to experimentals. As experimental continue 
to work and pay taxes, they should continue to benefit ^coo their enroll- 
ment in the New Jersey OJT program. Government budgets should also, in 
time, receive a net gain from operating the program. However, the 
magnitude of these net gains is uncertain. Using alternative reasonable 
assumptions about the projected future effects of the program, net benefits 
to experimentals over the full five-year period aie likely to be between 
$971 and $1,554. Similarly, the analysis estimates that the pi >gram will 
break even within two and a half years of randan assignment and receive a 
net gain over five years of between $601 and $1,284. 
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II. The Analytic Approach 

In determining the benefits and costs of New Jersey's OJT program, the 
analysis estimates the value of the program's effects on key outcomes f and 
the cost of producing those effects. The main outcome variaoles for which 
MDRC collected data include the earnings and AFDC payments discussed in the 
impact analysis in Chapter IV. The benefit-cost analysis also considers a 
variety of outcomes not directly measured, but for which values could be 
imputed: the fringe benefits of regular jobs; tax payments; Medicaid; Food 
Stamps; transfer program administrative costs; and the value ot output 
produced by members of the research sample employed in OJT, unsubsidized, 
and unpaid WIN work experience jobs. The analysis weighs experimental- 
control differences in these outcomes against costs that include: OJT wage 
subsidies and administrative costs; the expense of operating the regular 
WIN program for members of the research sample; expenditures for support 
services such as childcare and transportation received by experimentals and 
controls who participated in regular WIN activities; r.nd the costs incurred 
by JTPA agencies for providing education and training services for sample 
members. 

The principal object of this analysis is to determine the average 
benefits and costs of New Jersey's OJT program for each member of the 
experimental group above and beyond what would have happened if she had not 
been eligible for placement in an OJT position. As with the analysis of 
program impacts in Chapter IV, costs and benefits are averaged over all 

experimentals: those who were employed in OJT positions and those who were 

. 3 
not. 

The observation period varies by data source and date of random assign- 
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raent for each sample member. (See Table 2.5 for further details.) For the 
early sample, the observation period for earnings data ranges frcm nine 
quarters for the earliest enrollees to six quarters for the last enrollees 
randcmly assigned (not counting the quarter of randan assignment); by 
contrast, the later sample has between three and five quarters of earnings 
data, depending on the period of random assignment. The observation period 
for AFDC payments data ranges from 24 to 35 months for the early sample and 
from 15 to 23 months for the later sample. Benefits and costs accruing 
after the end of the observation period up to a point five years frcm the 
date of randcm assignment have been estimated for each sample member on the 
basis of observed data and a series of assumptions. All benefits and costs 
have been valued in 1986 dollars and discounted (for forgone investment) to 
the end of the first year of follow-up. 

In considering the estimated benefits and costs of the New Jerbey OJT 
Program, it is important to remembir the assumptions governing the analysis 
as well as the limitations of the estimation procedures. The analysis 
assumes no displacement o£ other workers, even though seme OJT employers 
may have used the OJT program to fill job openings that they had been 
planning to fill anyway. The five-year benefit projections also assume 
that regulations governing the calculation of taxes and transfer payments 
during the randcm assignment and follow-up periods remained in effect 
throughout the projection period. (The analysis does take into account 
changes in fedr al income tax regulations). However, passage of new 
federal welfare legislation, increases in the minimum wage, further changes 
in the 'ax system, or other new legislation could alter sample members' 
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labor market behavior and welfare experiences, and thus future benefits and 
costs. 

While available data permit estimation of a wide array of benefits and 
costs, some potentially useful information was not included in this study, 
such as UI benefits, General Assistance payments, and the earnings or other 
income of family members of individuals in the research sample. In addi- 
tion, potential intangible effects of the New Jersey OJT Program, such as 
changes in participants' self-esteem or in the quality of theJr f mily 
life, could not be determined. 

Finally, the demonstration itself probably affected program costs and 
benefits — although the extent of these effects is difficult to estimate. 
For instance, job developers had to work with fewer enrollees than they 
otherwise would have because half of the sample was randomly assigned to 
the control group. The demonstration may also have increased the overall 
use of WIN and JTPA services by sample members, since seme job developers 
seem to have made a special effort to enroll controls or experiraentals who 
weren't placed in OJT positions in alternative employment and training 
activities. 4 Interpretations of the benefit-cost analysis presented below 
should recognize the scope of the analysis. 



III. Economic Value of Program Effects 
A. Earnings and Output 

As seen in Chapter IV, experiment lis earned on average V468 more than 
controls during the fifth through seventh quarters following random 
assignment. The estimates in Table 5.1 include these earnings gains but 
extend the period for estimating program effects to include those that 
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TABLE 5.1 



NEW J ERSE Y 

ESTIMATED EXPERIMENTAL-CONTROL DIFFERENCES IN EARNINGS, 
FRINGE BENEFITS, AND TAXES PER EXPERIMENTAL 
FOR THE OBSERVATION PERIOD 0 
(EARLY SAMPLE) 



Component of Analysis 


E s t i mo t e 


Earn! ngs 






OJ T Empl ayment 




$695 


Unsubsidized Employment 




197 


TO tOl 




892 


Fr i nge Benef 1 ts 






OJ T Empl ayment 




84 


Unsubsidized Employment 




24 


Total 




108 


Taxes 






Pay rol 1 Taxes 




76 


Federal Income Tax 




62 


Stote Income Tox 




8 


Stote Soles and Excist Taxes 




9 


Total 




1 5* 


Sample Size 


508 



SOURCE: MDRC calculations from Unemployment Insurance earnings 
records ond from published data on OJ T wage subsidies, tax rates and 
em^! ayee benef i ts. 

NOTES : Differences ore regression-adjusted using ordinary least 
squores, controlling for pre-random assignment characteristics of sample 
members. Because of raund 1 g, detail may not sum ta totals. 

a 

The end of /he observation period was March 1987 far 
Unemployment Insurance earnings and OJ T wage subsidies. 



occurred from the second quarter following random assignment through the 
end of available follow-up. Consequently, these estimates differ from the 
earnings impacts for the early sample presented in Chapter IV f which 
instead cover the follow-up shared by all sample members. 5 

Table 5.1 shows the earnings differences during the observation period 
and subdivides earnings gains into those associated with employment in both 
subsidized OJT jobs (based on OJT employment records and published data on 
wage subsidies) and unsubsidized jobs. Subtracting average OJT earnings 
from the total earnings impact produces these two estimates. 6 Experimen- 
tal in the early sample shew an increase in earnings of $892 over the con- 
trol group average. Nearly 80 percent of the earnings gain was associated 
with OJT employment. 

The table also presents an estimata of net gains in the value of 

fringe benefits of $108, of which $84 was associated with OJT employment. 

These estimates assume a benefit rate — based on national employment data 

7 

— of 12 percent of earnings for both OJT and unsubsidized employment. 
(Payroll taxes are considered separately below. ) 

Under standard economic assunptions, the wages and fringe benefits 
that workers receive reflect the value of their output to employers and 
(barring displacement or other negative effects on others) to society. 
Whether this applies to OJT employees, who require a subsidy to induce 
erployers to hire them and who may not be as productive as other new 
employees, is uncertain. However, previous MDRC research on the relative 
productivity of welfare recipients in OJT positions and work experience 
jobs suggests that OJT employees were about as productive as regular 

Q 

unsubsidized workers. Thus, experimental • gains in earnings and fringe 
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benefits also represent increased output in the Mew Jersey economy as a 
result of the OJT program. 

Normally, the gains from increased output go to employers but are off- 
set by the cost of wages, fringe benefits, and payroll taxes. Therefore, 
employers break even. However, OJT employers do better because .hey 
receive the benefit of OJT employees' output and are reimbursed for half 
these employees' wages during their trial employment. For the early 
sample, the net gain to OJT employers is $348. 

As discussed in Chapter III, some experimental and controls were 
employed in unpaid work experience jobs. This also benefits society 
because employers (in this instance government agencies or not-for-profit 
organizations) receive the full value of these employees' output and do not 
have to compensate them for their work. 9 Therefore, the benefit-cost 
analysis includes the value of these services. 

As shown in Chapter III, eligibility for OJT employment resulted in a 
small decrease in experimental ' participation in work experience compared 
to controls. MDRC estimated the resulting net loss of value of output to 
be $9. 10 

B. Tax Payiuents 

Earnings gains for early-sample experimental during the observation 
period increased yields in federal and state income taxes, Social Security 
and UI Compensation payroll taxes, and state sales and excise taxes. These 
gains to the government budget and to taxpayers offset some of the cost of 
running the OJT program. Using the relevant tax rates, this evaluation 
imputed these taxes from earnings (total earnings in the case of payroll 
taxes and earnings over a base amount for income taxes) and combined income 
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from earnings and AFDC payments (for sales taxes). The estimate of federal 
taxes in Table 5.1 is based on tax rates for 1986 and includes a deduction 
for the Earned Income Tax Credit. 11 

The results in Table 5.1 show that the estimated total taxes paid by 
experimentals during the observation period exceeded average tax payments 
for controls by $156 — nearly half of which was the result of increased 
Social Security and UI Compensation taxes. 

C. Reduced Dependence on Transfer Programs 

As shown in Chapter IV, experimentals received less AFDC income as a 
result of their eligibility for OJT jobs. However, a portion of these 
savings was diverted to the county wage subsidy pools to finance additional 
OJT employment. To a lesser extent, the program also affected experimen- 
tals' use of Medicaid and Food Stamps, although not always in the same way. 

As with the estimate of earnings gains, the experimental-control 
difference in the direct receipt of AFDC income was estimated frcm AFDC 
records from the second quarter after random assignment to the end of avail- 
able follow-up. Table 5.2 displays the experimental-control difference in 
receipt of AFDC income during this period and the average value of diverted 
AFDC grants. MDRC estimated the value of diverted grants from AFDC payment 
and OJT employment records. The value cf the diverted grant was the differ- 
ence between maximum allowable payments and payments received during months 

12 

in which grant diversion calculations would normally be performed. On 
average, experimentals received $485 less in welfare payments than 
controls. About 72 percent of these savings, or $351 per experimental 
($862 per OJT employee), was diverted to finance OJT employment, leaving a 
$134 net AFDC savings to the government during the observation period. 



la 
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TABLE 5.2 



NEW JERSEY 

ESTIMATED EXPER I MENTAL- CONTROL DIFFERENCES IN TRANSFER PAYMENTS 
AND ADMINISTRATIVE COSTS PER EXPERIMENTAL 
FOR THE OBSERVATION PERIOD 0 
(EARLY SAMPLE) 



Type of Payment or Cast 


Estimate 


Tronsfer Payments 




AFDC 




Regul ar Payments 


$-485 


Diverted Payments 


35! 


Medical d 


9 


Food Stamps 


-51 


Tatal 


-176 


Administrative Casts 




AFDC 


-14 


Medicaid 


I 


Foad Stamps 


-14 


Tatal 


-27 


Sample Size 


508 



SOURCE: MDRC calculations from AFDC payments records. New Jersey WIN 
Grant Diversion On Baord Summary Reports. Unemployment insurance earnings 
records ond published data on Medicaid. Food Stomps and AFDC payments and 
administrative expenditures. 

NOTES: Differences are regression-adjusted using ordinary least 
squares* controlling for pre-random assignment characteristics of sample 
members. Because of rounding, detail may not sum ta totals. 

a 

The end of the observation period was August 1987 far AFDC 
records and March 1987 far Unemployment Insurance earnings records. 
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Differences In Medicaid use were Imputed from observed differences In 
AFDC receipt and the rules covering Medicaid eligibility. A person on AFDC 
Is automatically entitled to receive Medicaid and remains eligible for up 
to nine months after leaving the rolls, depending on her subsequent employ- 
ment and earnings. Under a special waiver, OJT employees were eligible for 
Medicaid throughout their contract period, even if their OJT earnings were 
high enough to disqualify them for AFDC. Once the contract period ended, 
however, OJT employees were subject to the normal Medicaid eligibility 
regulations governing AFDC recipients and could receive up to nine 
additional months of Medicaid eligibility. The special rules for OJT 
employment provided a valuable short-terra benefit for OJT employees that 
was intended to ease their transition frcm welfare and publicly financed 
health insurance to private sector employment and privately fincnced health 
insurance. For the state budget, this special waiver represented a short- 
term investment in anticipation of long-term savings in Medicaid payments, 
once the burden of providing health care insurance was shifted to employers 
or to the former recipients themselves. 

The average change in the value of Medicaid was determined in four 
steps. First, using aggregate AFDC and Medicaid data, MDRC estimated the 
average value of Medicaid used by AFDC recipients (the actual recipient of 
the grant and her dependents) during a single month to be nearly $74 in 
1986 dollars. Jhis per-recipient cost was then multiplied by the number of 
recipients on the sample member's AFDC case to produce a monthly average 
for Medicaid received by the household as a result of the sample member's 
Medicaid eligibility. 13 Third, the analysis estimated the total value of 
Medicaid received during the observation period by multiplying the average 
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monthly Medicaid payment by the nucther of months in which the sample member 
was eligible for Medicaid. Finally, a regression-adjusted, experimental- 
control difference in total Medicaid payments was estimated. 

Table 5.2 presents the results. During the observation period, experi- 
mental received $9 more in Medicaid payments than controls. This slijht 
increase in Medicaid payments probably results from the combined effects of 
the eligibility of OJT employees for the length of their contract period 
and the relatively rapid exit fran AFDC by controls. During the first year 
following randan assignment, experimental averaged $43 more in Medicaid 
than controls. However, for the rest of the follow-up period, experimen- 
ts received $34 less in Medicaid payments, indicating a trend toward 
small savings in Medicaid payments c ice both groups were working at 
unsubsidized jobs. 

Differences in Food Stamps were imputed from total income from 
earnings and AFDC payments. Estimates included the earnings disregard as 
well as childcare and medical deduccicns — all of which are used to 
determine eligibility for Food Stamps and the amount of permitted 
benefits. 14 No special rules govern receipt of Food Stamps during OJT 
employment; therefore, earnings gains associated with OJT employment should 
decrease Food Stamp use by OJT employees and, hence, by the experimental 
group as a whole. 

Table 5.2 displays experimental-control differences in the value of 
Food Stamps received during the observation period. Experimentals show a 
$51 decrease over the control average. Two-thirds of the decrease occurred 
after the first year of follow-up. 

New Jersey's OJT program produced a $176 net savings in transfer 
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payments, as decreases in AFDC income and Food Stamps exceeded the cost of 
grant diversion and Increased Medicaid payments. These savings were 
accompanied by an additional $27 decrease in the cost of transfer program 
ackninistration. ^ 

D. Future Effects and Total Results 

The effects discussed thus far pertain only to the observation period. 
Yet, program effects will almost certainly last longer. The analysis thus 
projects outcomes for each sample member, so that the combination of 
observed and extrapolated values covers five years from the point of random 
assignment. Because the amount of observed data on sample members varies 
according to when they entered the research sample, the length of the 
projection period required to estimate results over five years also varies. 
For the early sample, the projection period for earnings-based benefit 
estimates (these include taxes, Medicaid, and Food Stamps, as well as earn- 
ings and fringe benefits) ranges from 2.5 years for sample members randomly 
assigned between October and December 1984 to 3.25 years for sample members 
randomly assigned between July and September 1985. An additional five 
months of follow-up for AFDC payments shortens the projection period for 
estimates of future AFDC payments and AFDC administration expenditure, 
cor r espondi ngly • 

Projection of program effects requires choosing a base period from 
which the projection is made, making assumptions about the rate at which 
experimental-control differences change over time, and selecting an 
appropriate discount rate. As in previous MDRC reports, this analysis uses 
the average of the last two quarters of earnings data (October 1986 to 
March 1987) and a quarterly average based on the last six months of 
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available AFDC payments data (March to August 1987) as the base periods for 
projecting future benefits. 

The decay rate is the rate at which the base period estimate is 
assumed to change over time. This study's relatively short follow-up makes 
it difficult to predict long-term trends from available data. Two decay 
rates have therefore been used to compute a range of estimates. The first 
assumes that the magnitude of the experimental-control difference observed 
during the base period will continue unchanged during the projection 
period. In other words, the decay rate for projected benefits will be zero 
percent. This assumption, which is relatively optimistic and serves as the 
upper bound for the five-year estimates, is reasonable because earnings 
impacts were sustained in Maine's OJT program (TOPS) over a three-year 
observation period and in New Jersey during a shorter observation period. 
Moreover, program effects could actually increase over time, as was demon- 
strated in the analyses of longer-term earnings impacts of two previous 

work/welfare initiatives, Supported Work and the Baltimore Options 
17 

Program. 

The second decay rate assumes a straight-line decrease in program 
benefits frcm the value displayed during the base period to zero during the 
final quarter of the projection period. To illustrate: If earnings gains 
averaged $100 during the base period and 2.5 years (or ten quarters) 
comprise the projection period, the impact will drop to $90 during the 
first quarter of the projection period, $80 during the second, $70 during 
the third; and so on, to zero during the tenth and final quarter. In this 
example, the cumulative impact over the projection period is the sun of 
these quarterly impacts or $450. in effect, the annual decay rate acceler- 
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ates from 40 percent during the first year, to 67 percent during the second 
year, to infinity beyond the third year. This lower bound estimate is 
arbitrary and was chosen to provide a relatively large range within which 
the actual value of program effects will probably fall. 

Again, it is conceivable (but unlikely given observed trends in earn- 
ings and AFDC receipt) that program effects will fall below the lower esti- 
mate. One example of using an extremely pessimistic assumption to estimate 
future effects is to claim that program effects fall to zero inunediately 
after the end of the observation period and remain there throughout the 
projection period. The decay rate in this instance is infinite. When 
program impacts are shewn to be positive (or even close to zero) under this 
more extreme and unlikely negative assumption, one can confidently conclude 
that the program is cost-effective* Estimates of program effects based on 
this assumption are discussed below and in Section V of this chapter. 

The effect of inflation on the value of future program effects was 
avoided by expressing base period estimates and projected amounts in 1986 
dollars* Further, all extrapolated results were discounted to adjust for 
the value of forgone investment. (A benefit received later in the follow- 
up period is worth less than the same benefit received earlier due to the 

lost opportunity to invest. ) A real discount rate — that is, a rate ad- 

18 

justed for inflation — of 5 percent per year was used in this analysis. 

Table 5.3 presents the observed, projected, and total estimates of 
program effects during the five-year time period, in each table the column 
headed Ccmmon Follow-up shews the effects estimated for the portion of the 
follcw-up period available for all sample members. To compare the early 
and later samples, the common period, comprises the maximum follow-up 
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TABLE 5.3 



NEW JERSEY 

ESTIMATED BENEFITS DURING THE OBSERVATION PERIOD, 
PROJECTION PERIOD. AND OVER FIVE YEARS AFTER RANDOM ASSIGNMENT. 

PER EXPERIMENTAL 
(EARLY SAMPLE) 





Observotion Period 


Projection Period 


Five Yeor Totol 


Benef i t Vor iobl e 


I VUI III V II 

Foi i ow -up 


aq a 1 t i o no 1 
Fot 1 ow- up 


r r o | ec t 
Bose 


^on Pro) ected 
Amount 


(Observed PI us 
Pro) ected) 


Eornings ond Fringe 
Benef i t s 
OJ T Employment 
UnsuDsi dized 
Empi oyment 


$712 
-41 1 


$68 

632 


$0 

222 


$0 

1211 to 2350 


$779 
1432 to 2571 


Pay rol 1 Toxes 


23 


53 


17 


92 to 179 


169 to 256 


income ond Soles Toxes 


-6 


86 


27 


146 to 303 


226 to 383 


AFDC Payments 
Regui or 
Diverted 


-274 
321 


-211 
31 


-36 
0 


-167 to -315 
0 


-652 to -801 
351 


Other Transfer 
Payments 


26 


-68 


-79 


-159 to -337 


-201 to -379 


Transfer Progrom 
Administration 


13 


-40 


-9 


-45 to -86 


-72 to -113 



SOURCE: See Tables 5.1 ond 5.2. 

NOTES: Becouse of rounding, detail may not sum to totois. 
o 

Bosed on avoiloble foilew-up doto 

b 

The projection bose period is a quorterly overoge of the lost two 
quarters of avoiiable follow-up. Progrom effects observed during this bose period 
ore multiplied by o projection factor to estimote benefits from the end of the 
observotion period to five years from the point of random assignment. 

C The first number of eoch ronge ossumes a strolght line decay of 
impocts to $0 by the end of the five-year period; the second number ossumes thot the 
most recent program effects continue for eoch remoining quarter of the five-year 
period. 




-108- 



available to individuals who entered the sample during April tc June 1986: 
quarters two througl four for earnings, and two through five for AFDC 
payments. The column headed Additional Follow-Up provides estimates of 
program effects during the remainder of ttie observation period. Summing 
the values in these two columns yields the observed program effects 
presented in Tables 5.1 and 5.2. 

Dividing the observation period in this* way reveals a dramatic differ- 
ence in the effect of New Jersey's OJV program on the 41 percent of experi- 
raentals who found employment in OJT positions and the remaining 59 percent 
vho did not. During the first year after random assignment ( che Ccmmon 
Period), exper iraentals averaged $301 ^ore in earnings and fringe benefits 
than controls. However, thJ effect of New Jersey's OJT program is actually 
composed of two effects: a positive effect of $712 in earnings and fringe 
benefits for experiraentals while in OJT jobs, and a negative effect of 
-$411 for unsubsidized earnings. This short-terra negative effect on un- 
subsidized earnings is probaLly associated with two phenomena. First, many 
OJT employees would likely have found unsubsidized jobs had they not been 
eligible for OJT employment. In effect, their earnings from OJT jobs 
substituted for earnings fran unsubsidized jobs. Second, the rest of the 

experimental group who weren't employed in OJT jobs did not find unsubdi- 

19 

dized jobs as quickly as controls. During the rest of the observation 
period, unsubsidized earnings and fringe benefits made up 90 percent of the 
early-sample experiraentals' net gain in earnings and fringe benefits of 
$700. 

Similarly, for early-sample exper imentals, increases in AFDC payments 
and other transfers are displayed during the Ccmmon Period — primari y 
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because savings in APDC grants were diverted to the wage pool and because 
OJT employees were eligible for Medicaid during their trial employment. 
These increases were offset by even greater savings during the rest of the 
obseivation period, when the wa^e subsidy period had ended. (See Table 
4.5. ) 

When net losses to experimental from decreased transfer payments and 

higher taxes are subtracted from net gains in earnings and fringe benefits, 

the resulting difference indicates how well experimental fared as a result 

of their eligibility for OJT employment. For the entire observation 

period, experimentals in the early sample display a n^c gain of $330. 

(This estimate differs slightly from the one discussed in Section V 
20 

below. ) Since this estimate is already positive in the observation 
period, estimates based on infinite decay are likewise positive, and 
changing assumptions about future effects will onjy affect the magnitude of 
additional gains. 

The colunn in Table 5.3 headed Projected Amount presents a i.ange of 
values with the first number calculated assuming a straight-line decease 
in program effects and the second assuming zero percent decay. The column 
headed Base period displays the quarterly averages for the last six months 
of observed data upon which projections are based. The final column, which 
is simply the sun of observed and projected effects, indicates the esti- 
mated progr ef f ects dur ing the five-year period start ing at random 
assignment. 

In each of these *wo tables, the projected estimates using the 
straight-line decay assumption are somewhat larger than the observed esti- 
mates — including the estinu:ce of AFDC savings, once the cost of diverted 
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grants is taken into account. Utilizing the zero percent decay rate nearly 

doubles the projected amounts. 

For experimental s in the early sample, gains in earnings and fringe 

benefits range between $2,211 and $3,350 over a five-yv r period, while tax 

21 

yields increase by $395 to $639. Savings in welfare and other transfer 
payments and in expenditures for transfer payment administration range frcm 
$574 to $942, depending on assumptions. 

IV. Costs 

This section presents an analysis of experimental-control differences 
in the cost of services and support payments. Of greatest interest are the 
direct costs of providing OJT employment* These costs have two components: 
the cost of wage subsidies to employers and the cost of administering the 
program. Indirect costs concern expenditures ior providing additional WIN 
and JTPA services used by exper imentals in lieu of or in conjunction with 
OJT employment. The sun of direct and indirect costs is the total cost of 
the experimental program stream. Theoretically, in an OJT program for 
welfare recipients, a i rtion of the direct costs of placing recipients in 
OJT positions will be offset by savings in indirect costs, as recipients 
eligible for OJT employment use alternative services less. In this study, 
the costs of serving controls through the WIN and JTPA systems provide a 
benchmark for estimating these savings. 

In this section (and throughout the rest of the chapter), experi- 
mental-control differences in the <_wot of services are referr^i to as net 
costs . Table 5.4 displays the net cost of each WIN component as well as 
the net cost of adninistering and enforcing the WIN system; the net cost ot 
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support services for participants in WIN activities; and the net cost of 
JTPA acuities. Since controls were not eligible for OJT jobs, the net 
costs of the OJT component are equivalent to the average costs of serving 
experiraentals. The experimental-control difference in total costs, direct 
and indirect, is the net cost of the OJT program, i.e., the additional cost 
incurred frcro adding the OJT component to the WIN system. Again, in 
theory, this total net cost ought to be less than the direct cost of 
running the OJT component, as savings should be realized from decreased use 
of WIN and JTPA services by experiraentals. 

This section also discusses the average costs of providing services 
and support payments for all members of each research group. These average 
costs are referred to as gross costs . (For any activity or support pay- 
ment, subtracting the gross cost of serving controls from the gross cost of 
serving experiraentals produces the net cost.) Because the benefit-cost 
analysis is principally concerned with estimating the incremental effects 
of New Jersey's OJT program, net costs rather than gross costs receive the 
greatest attention. 

Both gross costs and net costs are averaged over all experimentals — 
including those who never worked in an OJT position and nonparticipants in 
WIN and JTPA activities. To give a ^nse of the absolute cost of providing 
services and support payments, the analysis estimates the average cost of 
OJT employment for the 41 percent of experiraentals who actually worked in 
OJT jobs, as well as the average cost for individuals who actually parti- 
cipated in a WIN or JTPA activity or received a support payment from the 
WIN system. These costs are referred to as per-eraployee or per-participant 
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NEW JERSEY 

ESTIMATED NET COSTS OF OJ T PROGRAM, OTHER WIN SERVICES 
4ND JTPA EDUCATION AND TRAINING ACTIVITIES, PER EXPERIMENTAL 

(EARLY SAMPLE) 





Cost Var i abl e 


Net Oi f f erence 


OJ T Program 




Wage Subsi dl es 


$348 


Operati ng Costs 


500 


Total 


847 


Other WIN Operati ng Costs 




Ke— re g i strati on 


o a 


Appral sa ! 


1 


Individual Job Search 


-15 


G r oup J ob Sea r ch 


-4 


Work Experience 


2 


I I y inct 1 hit 1 nnn 1 T r n i n i n n 

win i n » t i lUiiunui i i u i u i n y 


4 


Referral to Non-WIN Training 


-0° 


suspense to n on- w \ h subsiaizea cm p i oy me n t 


_ 1 


Ada i n i st r at i on and Enforcement 


-25 


1 0 TO 1 


- 3 9 


WIN Allowances and SUDDort Services^ 




Training Related Expenses 


-1 1 


Child Care Payments 


-10 


Total 


-21 


J TPA Operati ng Costs 


73 


Total Costs 


860 


Sample Size 


508 



SOURCE: MDRC calculations from New Jersey 2SAR S and JTPA Automated 
Reporting System; Grant Diversion Financial Records; D0L Training Related 
Expenses records; DHS-PEP childcare vouchers; New Jersey WIN Grant 
Diversion Project On Board Summary Reports; published WIN, JTPA, and 
DHS-BEP expenditure and participation records. 

NOTES: Becouse of rounding, detail mjy not sun to totals. 

°Less than $0.50 and greater than -$0.50. 

^Estimates are calculated from a subsampie of 377 
experimental s and controls randomly assigned between January and June 19 86. 
The subsampie is weighted to replicate the distribution of sample members 
randomly assigned during these months. 
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costs. Unlike the estimate program benefits, cost calculations are not 

22 

regression adjusted. 

Estimates of program costs use all available follow-up for program 
tracking records (21 to 32 months); however, the analysis assunes that no 
further costs are incurred beyond the observation period. This assumption 
is reasonable because after December 1986 (or six months before the end of 
the observation period ) , OJT job developers were no longer writing OJT 
contracts for members of the research sample. Also, the participation 
rates of experiraentals and controls in alternative WIN and JTPA services 
were similar during the observation period. This suggests that net 
differences in the use of these services (and hence net costs) will be 
close to zero in future years. 

Each net cost was estimated In several steps. The first step was to 

determine the "unit cost," that is, the average cost of providing a single 

23 

unit of service to one person. Published data on WIN and JTPA expendi- 
tures and participant counts for FY 1986 were used for estimating unit 
24 

costs. All costs are expressed in 1986 dollars to permit comparison with 
program benefits. Separate unit costs were estimated for each county or 
SDA. 

Next, for each research group, MDRC calculated the average nunber of 

units of service that group members used. Due to budgetary constraints, it 

was necessary to simplify this calculation for alternative WIN and JTPA 

activities by assuming that no one participated in an activity more than 

25 

once during the follow-up. For these activities the per-participant cost 
is either the county or SDA unit cost for those who participated in the 
activity during the follow-up or zero for those who did not. These per- 
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participant costs were then averaged over all members of each research 
group to produce the grors costs* Subtracting the gross costs for controls 
frao the gross costs for experiment als yields the net costs of each 
activity. 

It was possible to account for multiple instances of service in esti- 
mating the direct costs of operating the OJT component, the cost of WIN 
administration and enforcement, and the cost of WIN support services. Per- 
participant cost estimates were obtained by multiplying the unit costs ty 
the nunber of units of service used. These estimates were then averaged 
over all members of the research group to produce the gross costs. As 
previously, the net cost was the experimental-control difference in gross 
corts. Costc are displayed in Table 5.*. 

A. New Jersey OJT Program Operating Costs 



derived from published quarterly data on cumulative expenditures for wage 

subsidies; published counts of the nunber of OJT placements; and OJT 

employment records for members of the research sample. These estimates are 

approximate because the cumulative expenditure data include wage subsidies 

26 

for individuals not in the research. 

Budget limitations made it necessary to estimate the average wage 

subsidy indirectly. Published data on employer subsidies indicate that the 

OJT program spent $451,097 (in 1986 dollars) between April 1984, the start 

27 

of the OJT pilot project, and March 1987 to subsidize 562 OJT placements. 
All but one experimental had finished her OJT by the latter date, so that 
after March, the program was paying wage subsidies almost exclusively for 
individuals not in the research. According to OJT employment records, 



Employer subsidies . 



Estimates of employer subsidies are 
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members of the early sample worked in 220 of these OJT jobs (39.1 percent). 
Thus, it is assumed that early-sample members accounted for 39.1 percent of 
wage subsidies or $176,586. Averaged over the 207 OJT employees in the 
early sample ( 13 had a second OJT job), the per-employee cost of wage 
subsidies was $853. Averaged over all experimental, the gross cost was 
$348. 

2. OJT operating costs . Administrative costs for the OJT 

program were derived from WIN expenditure records for staff and nonstaff 

costs during FY 1986; data on New Jersey DHS administration costs for the 

program; published counts on OJT placements during FY 1986; and OJT employ- 
28 

ment records. The analysis estimates that total costs for administering 
the OJT program during FY 1986, including fringe benefits and nonstaff 
costs, came to $334,570 (in 1986 dollars). During this period, the program 
made 290 OJT placements (including placements for members of the later 
sample). The administrative cost of placing one person in an OJT job was 
therefore $1,154. Multiplied by the 220 OJT jobs accounted for by early- 
sample experimentals and averaged over all 508 members of the research 
group, the gross cost of administering the program was $500 ($1,226 per OJT 
employee). Combined gross costs of wage subsidies and OJT program admin- 
istration come to $847 per experimental and $2,079 per OJT employee. 
B. The Cost of Other WIN Services 

Estimates of the net cost of operating the New Jersey WIN system for 
experimentals and controls are based on published WIN staff and nonstaff 
expenditure reports for FY 1986; New Jersey DHS, Bureau of Employment 
Programs expenditure reports for the same period; and published partici- 
pant counts for WIN activities. 29 This section presents net cost estimates 
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for all WIN activities in which sample members participated after random 
assignment: registration for WIN; appraisal; individual job search 30 ; Job 
Club; work experience; referrals to WIN institutional training; referrals 
to non-WIN training; and referrals to non-WIN subsidized employment. The 
administration and enforcement category includes costs associated with 
caseload management: scheduling; counseling; enforcing program regulations; 
deregistering sample members; sanctions; and recordkeeping. 

In the New Jersey WIN system, program staff record hours devoted to 
specific activities and charge their time accordingly. For each activity, 
a unit cost can then be calculated, which represents the total cost of 
staff time devoted to the activity during FY 1986, marked up for fringe 
benefits and nonstaff costs, and divided by the nunber of instances of 
participation in the activity. Unit costs for each WIN activity were 
estimated for each of the nine counties in the demonstration. Gross and 
net costs were estimated as described at the beginning of this section. 
Table 5.4 displays net costs for WIN components. 

Alternative WIN activities are less staff-intensive than the OJT 
program. All but one component carried per-participant costs of under $200 
— or less than 10 percent of the total per-eraployee cost of the OJT 
program. (The little-used WIN institutional training component cost $850 
per participant. ) Gross costs, which reflect the experimental and control 
participation rates discussed in Chapter III, averaged less than $10 per 
activity, except for the cost of individual and group job search: about $80 
and $40 respectively. As displayed in Table 5.4, experimental-control 
differences in the cost of alternative WIN services were small: Only indi- 
vidual job search had a net cost over $15, and the total difference in the 
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cost of WIN services was $2 less — not counting the cost of administration 
and enforcement. 

1- Administration and enforcement . The cost of administration 
and enforcement encompasses all WIN staff costs, marked up for fringe 
benefits and nonstaff costs, that were not attributed to specific acti- 
vities, plus expenditures for serving sample members incurred by New Jersey 
DHS, Bureau of Employment Programs. 31 For each of the nine counties in the 
demonstration, the combined expenditures for FY 1986 were divided by 12 to 
approximate a monthly cost; in turn, the monthly cost was divided by the 
average number of WIN registrants per month during FY 1986 to produce an 
estimate of the average cost of administration and enforcement for one WIN 
registrant for one month. 

To estimate the per-participant cost, the county unit cost of admin- 
istration and enforcement was multiplied by the number of months in whici u 4 
the sample member was registered during the follow-up. *'or experiraentals, 
the cost of WIN administration and enforcement was set to zero for every 
month employed in an OJT job. This modification was warranted because the 
OJT program incurred the cost of serving OJT employees for these months. 32 

Table 5.4 displays the experimental-control difference in the cost of 
WIN administration and enforcement. Like the costs of running WIN 
components, the remaining costs of operating the system were relatively 
lew. Gross costs for experiraentals in the early sample were i>147, based on 
an average of 13.7 months registered for WIN (15.2 total months minus 1.5 
months in OJT jobs). Controls averaged 15.4 months in the WIN program and 
accumulated gross costs of $172. The experimental-control difference or 
net cost of Administration and Enforcement was only -$25. 
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C. Support Services 

The New Jersey WIN system paid participants in WIN activities an 
average of $4.50 per day to cover training-related expenses. Participants 
in WIN activities were also eligible to receive childcare money from New 
Jersey DHS, Bureau o£ Employment Programs: up to $160 per child per month, 
OJT employees were not eligible to receive these support services. In- 
stead, they, like any other AFDC recipient who had found a job, were 
reimbursed for these expenses indirectly through their AFDC grant calcula- 
tion. Specifically, they received an automatic $75 per month deduction for 
work-related expenses and were allowed to deduct up to $160 per monti per 
child for childcare costs frcm the value of earnings used to figure welfare 
grants. These deductions in turn permitted OJT employees to keep more of 
their welfare grant. However, if OJT wages exceeded 185 percent of New 
Jersey's standard of need, the .JT employee received zero dollars in AFDC, 
irrespective of work-related or childcare expenses. ^ 

In theory, New Jersey's OJT program should produce an indirect savings 
in support service costs because recipients eligible for OJT employment are 
supposed to participate less often in other WIN activities and consequently 
require fewer support payments. This hypothesis is tested by estimating 
the experimental-control difference in support service costs. 

As discussed in Chapter II, the cost of Training-Related Expense (TRE) 
payment? was estimated for a subsample of 377 experimental and controls 
randomly assigned from January to June 1986. The analysis used TRE records 
and childcare vouchers frcm randan assignment through May 1987 to estimate 
these costs. Budgetary constraints prevented an examination of payment 
records for members of the early sample; therefore, the net cost for 
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support payments derived from this subgroup from the late sample will be 
used for both samples. 

Table 5.4 presents the net costs of TRE and childcare payments. About 
half of the 377 members of the subsample received at least one TRE payment; 
payments per recipient averaged $96. The gross costs of TRE payments were 
$46 for experiroontals and $57 for controls, resulting in a net savings in 
TRE payments of $11. Receipt of BEP childcare payments was much less 
common: only about 8 percent of the sample received a payment and recip- 
ients of childcare payments received only $252 on average throughout the 
follow-up. Again, gross costs were slightly lower for experiment als — 
$19, compared to $29 for controls. Thus, the OJT program yielded a net 
savings in BEP childcare costs of $10 and a combined savings in childcare 
and TRE costs of $21. 

D. Total WIN Costs 

Among the early sample, experimental averaged $349 in WIN activity, 
administration and enforcement, and support service costs. This amount 
represents an additional expense of 41 percent above the cost of running an 
OJT program for the same individuals. Total WIN costs for early sample 
controls averaged $409. The combined savings resulting from decreased use 
of WIN services and support payments was $60 — equivalent to 7 percent of 
the combined cost of OJT wage subsidies and administrative costs. As dis- 
cussed previously, the absence of greater savings resulted frcro the failure 
of the program to place most experimental in OJT jobs as well as the 
frequent use of alternative WIN services by experiment als. 




E. JTPA Costs 

In theory, New Jersey's OJT Program should produce indirect savings in 
JTPA expenditures because exper imentals substitute OJT employment for JTPA 
training. The analysis tests the hypothesis by estimating the experi- 
mental-control difference in JTPA costs. 

To estimate the net cost of providing education and training services 

through New Jersey's JTPA system, MDRC obtained automated JTPA enrollment 

records for each sample member from the point of random assignment through 
34 

May 1987. The cost calculations included participation in JTPA acti- 
vities that occurred during the follow-up period, whether or not the person 
was still registered with New Jersey WIN at the time of participation. 

Over 90 percent of JTPA participants among the research sample took 
part in activities funded through Title II A of the program. MDRC there- 
fore used published expenditure and enrollment data for TitJe II A for each 
SDA for Program Year 1985 (July 1985 through June 1986) to derive unit 
costs of participation. For each New Jersey SDA, MDRC estimated the unit 
cost by dividing total expenditures during the fiscal year by total 
tmollees. Is with estimated per-participant costs of WIN components, MDRC 
credited each JTPA participant with the unit cost for her SDA. (Length of 
time in that activity was not a consideration. ) Summing per-participant 
costs for each sample member and averaging across the entire research group 
produced the gross costs of JTPA. The experimental-control difference in 
these gross costs represents the net cost of the program. The net cost of 
JTPA services is displayed in Table 5.4. 

JTPA education and training activities use staff resources more inten- 
sively than do most WIN components. Average per-participant costs were 
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$1,886. As discussed lr chapter III, early-sample experimental actually 
used the JTPA system more than controls did: nearly 21 percent of experi- 
mental compared to 17 percent of controls participated in a JTPA activity 
during the first year after random assignment. This difference persisted 
through the remaining follcw-u>, resulting in gross costs of $445 for 
experiment als and $3 73 for controls. The net cost of JTPA services was 
$73. 

F. Summary of Costs 

Experimental s in the early sample received, on average, $1,642 in 
services and support payments from New Jersey's OJT program, alternative 
WIN services, and the JTPA system. This cost is considerably higher than 
was found in mandatory WIN job search and work experience programs studied 
by MDRC as part of its demonstration of work/welfare initiatives, but less 
than the average cost of Maine's TOPS program. 35 About $794 (48 percent) 
of this amount represents the cost of providing services other than OJT 
employment. This means that unless New Jersey's welfare administrators 
design and implement an OJT program that increases the OJT employment rate 
and gets eligible participants into OJT employment faster (a formidable 
challenge, as New Jersey placed more individuals in OJT positions than any 
of the other five states in OFA's OJT demonstration), the indirect costs of 
the program are likely to be nearly as high as the direct cos*s of provid- 
ing OJT employment. 

Total costs for providing WIN and JTPA services to controls in the 
early sample averaged $782. This amount Is high compared to gross costs of 
serving controls in other work/welfare programs and indicates that controls 
were highly served. Total net costs averaged $860 per experimental — 
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roughly equivalent tc the additional cost of providing OJT employment 
services to individuals in the experimental group. Again, this indicates 
that under present operating conditions, the OJT program will not produce 
any indirect savings from decreased use of alternative services. 

V. Distribution of Results 

In this sect i on, the analysis c bines these estimates of net costs 
and benefits to produce a single measure of the cost-effectiveness of New 
Jersey's OJT program. This measure is referred to as net present value and 
is calculated by subtracting net costs from benefits. The analysis also 
considers the benefits and costs of New Jersey's OJT program from four 
perspectives: *he welfare sample, the government budget, taxpayers, and 
society (which combines the welfare sample and taxpayers). As explained 
below, the distribution of benefits and costs varies according to the 
perspective considered; therefore, a program can produce a net gain from 
one perspective (meaning that benefits exceed costs) but a net loss from 
another. 

t'rcKi a policy standpoint, this analysis is of considerable incerest. 
Estimates of net present value taken at particular points in time provide 
an important tool for assessing whether a welfare program is reducing the 
burden of welfare costs and improv . ig the economic standing of welfare 
recipients. However, the conclusions drawn from this analysis depend upon 
the magnitude, J'rection (negative or positive), and consistency of the 
estimates of net present value (i.e., if they are negative or positive from 
each perspective). For instance, if the net present value is very large 
(in a positive or negative direction), the estimate should indicate whether 




a program is financially worthwhile. If, on the other hand, net present 
value is close to zero, it means that the program is 'tweaking even" frcro a 
fiscal standpoint. Interpreting the value of continuing the current mix of 
program services or maintaining the current level of spending is then much 
less certain. Similarly, it is easier to gauge the cost-effectiveness of a 
program when the analysis indicates that it produces net gains or net 
losses from each perspective than when the program produces a net gain from 
one perspective but a net loss frcro another. The confidence with which one 
can evaluate a program based on estimates of net present value also depends 
on the amount of follow-up data on which these estimates are based and the 
extent to which the estimates depend on a&s'nuptlons abou'. future trends in 
program impacts. 

In this analysis of net present value, all benefits (except the value 
of output frcro work experience jobs) are projected to the end of the fifth 
year after randcro assiqnment. Benefits are presented as a range of values 
with a lew estimate based on an assumed straight-line decrease in impacts 
to zero at the end of the five-year period and a high estimate of zero 
percent decay. This analysis also uses the same estimates of net costs 
that were used in the previous section. Estimates of net present value 
based on the assumption of infinite decay are also presented for the two 
mcst important perspectives: the welfare sample and the government budgets. 
(See Appendix Table E. 1. ) 

The analysis of net present value is considered first from the perspec- 
tive of the welfare sample i.e., the exper imentals and controls. For 
the welfare sample, the benefits generated by the New Jersey OJT program 
are the additional earnings and fringe benefits received by experimentals 
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from OJT jobs and unsubsidized employment. Subtracted from these gains are 
losses to the group due to increased taxes owed on earned income and a 
reduction in transfer payments and WIN support services. 'able 5.5 and 
Appendix Table E. 1 present the benefits and losses estimated for the five- 
year time period and the estimates of net present value for the welfare 
sample. 

At, discussed in Section III. J), during the observation period experi- 
mentals in the early sample received net gains in earnings and fringe 
benefits that exceeded combined losses through increased taxes and losses 
in AFDC and other transfer payments by $330. Even when additional losses 
in WIN support payments are accounted for, exper imentals are still left 
with a $309 ne* gain. (See Table E. 1.) Thus, even assuming no further 
gains or losses (infinite decay) beyond the observation period, the welfare 
sample comes out ahead. However, since program effects will doubtless 
continue (even with sane decay of impacts), additional gains may be anti- 
cipated for the welfare sample. As displayed in Table 5.5, the analysis 
estimates a net gain for the welfare sample of between $971 and $1,554, 
depending on assumptions about the future course of program effects. 

The government budgetary perspective is of critical concern to policy- 
makers interested in budget savings. According to this perspective, 
smaller average transfer payments to experimentals and reduced costs of 
administering transfer payments constitute benefits. The government budget 
also benefits from the net increase in taxes paid by experimentals. 36 In 
this analysis, the government budget receives additional benefits from 
experimentals' decreased use cf alternative WIN services and lower average 
support payments. In contrast, net losses to the government budget result 




TABLE 5.5 



NEW J ERSEY 

FROM THE PERSPECTIVE OF THE WELFARE SAMPLE: 
ESTIMATED GAINS AND LOSSES PER EXPERIMENTAL OVER FIVE YEARS 

(EARLY SAMPLE) 



Component of Anal y si s 


Est 


i mate 


Gal ns 






Eornings and Fringe Benefits 






OJ T Em pi oy men t 




$779 


Unsubs i diz ed Employment 


1432 


to 25 7 1 


Losses 






Tax Payments 


-367 


to -596 


AFDC Payments 


-652 


to -801 


Other Transfer Payment s 


-201 


to -379 


WIN Allowances and Support Services 




-21 


Net Present Val ue° 


97 1 


to 1554 



SOURCE: See Tables 5.1, 5.2 ond 5.4. 

NOTES: Positive amounts Indicate a gain; negative amounts indicate 
a lass. All benefits and costs are estimated for a five-year period 
beginning at random assignment and are expressed in 1986 dollars. Because 
of rounding, detail nay not sum to totals. Results include estimates of 
projected program effects beyond the observation period (see Table 5.3). 

a 

The net present value Is the sum of all gains and losses. 
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from the net costs of OJT subsidies and program administration and the net 
increase in the use of the JTPA system by experimentals. Tables 5.6 and 
E. 1 present these gains and losses from the perspective of the government 
budget and provide estimates ^ net present value. 

By the end of the observation period, the government budget had 
incurred an $860 net loss frcm providing services to experimentals in the 
early sample — the result of combined net costs of $920 ($847 for OJT 
subsidies and administrative costs and $73 frcm increased use of JTPA 
services) offset by combined net savings of $60 ($39 from decreased use of 
WIN services and $21 less in average WIN support payments). During the 
observation period, the budget realized additional net gains of $773 from 
increased taxes and savings in transfer payments and transfer administra- 
tion. 37 The -$86 difference between net gains and losses (i.e., the net 
present value) during the observation period indicates that the government 
budget comes close to -^eaking even at the end of the two-year observation 
period for the early sample, while producing a $309 net gain for experi- 
mentals. 

Even if no additional budgetary savings were realized, this small loss 
to government budgets could be considered a more cost-efficient means of 
raising the income of welfare recipients than increasing welfare benefits. 
However, it is expected that experimentals will continue to average higher 
earnings than controls and the budget will continue to benefit from higher 
taxes and net savings in transfer payments and administrative costs. Using 
the straight-line decay assumption, the government budget breaks even in 
about 2.5 years after randan assignment and realizes a $601 net gain over 
five years. (See Table 5.6.) Under the assumption of zero percent decay, 



TABLE 5.6 



NEW JERSEY 

FROM THE GOVERNMENT BUDGET PERSPECTIVE: 
ESTIMATED GAINS AND LOSSES PER EXPERIMENTAL OVER FIVE YEARS 

(EARLY SAMPLE) 



Component of Anal y s 1 s 


Estimate 


Goi ns 








Pay rol 1 Taxes 


$310 


to 


$469 


i ncome and Sol es Taxes 


226 


to 


383 


AFDC Payments 


652 


to 


801 


Other Transfer Payments 


201 


to 


379 


Transfer Program Administration 


72 


to 


1 13 


Other WIN Operating Costs 




39 




win Allowances and Support Services 




21 




Losses 








OJ T wage Subsi di es 




348 




OJ T Opera tl ng Costs 




500 




J T PA Ope rati ng Costs 




-73 




Net Present Val ue° 


601 


to 


1 284 



SOURCE: See Table 5.1. 5.2 and 5.4. 

NOTES: See Tab I e 5.5. 
a 

The net present vqlue is the sum of all gains and losses. 
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the budget breaks even In 2.2 years and gains an additional $1,284 benefit 
over five years. 

Table 5.7 sunroarizes the net present value calculations for these two 
perspectives and introduces the final two perpectives in the analysis — 
those of taxpayers and of society. The taxpayers* perspective differs from 
that of the government budget in two respects. First, as discussed in 
Section III. A, taxpayers suffer a $9 net loss from decreased value of 
output frcro work experience jobs. Second, the taxpayers' perspective 
includes the net gains and losses of employers (OJT and other). For 
instance, as shown on Table 5.7, experi^entals' increased value of output 
from OJT and unsubsidized employment represents a net gain to taxpayers 
that is offset by the cost of wages and fringe benefits. Payroll taxes 
paid by employers represent a transfer from one group of taxpayers to 
another whose net effect is zero (although Social Security taxes paid by 
experimentals are a gain to all). Similarly, OJT wage subsidies are a gain 
to employers at the expense of other taxpayers; and the net effect is again 
zero. As displayed in Table 5.7, combined net gains (or net present value) 
over five yoar^ from the taxpayers' perspective range from $939 to $l,b23 
and are of similar magnitude to estimated gains for welfare sample. 

The final perspective presented here is that of society, wh ich 
includes both the welfare recipients and taxpayers. From this perspective, 
program effects that are a gain to one of thero groups but an equivalent 
loss to the other group yield no net benefits; they are simply transfers 
between groups. For example, the reduction in AFDC benefits is reither a 
net benefit nor a net loss to society: It is a loss to the welfare sample 
but a net gain to taxpayers. In contrast, the reduced administrative cost 
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TABLE 5.7 



NEW J ERSEY 

ESTIMATED BENEFITS AND COSTS PER EXPERIMENTAL OVER FIVE YEARS, 
BY RESEARCH GROUP AND ACCOUNTING PERSPECTIVE 
(EARLY SAMPLE) 

I 



Lornponeni or Analysis 


Accounting Perspectives 


wel fare Sample 


Budget 


Taxpayer 


Society 


Earnings 










OJT Employment 


$695 


$0 


$-695 


$0 


llncuhc 1 HItaH Cmnl numan t 

uiidUUd 1 a izoij c&pi oynien i 


1278 to 2293 


0 


-1 278 to -2293 


0 


Fringe Benefits 










0.JT Employment 


84 


0 


-84 


0 


line nhc I H S ?ori Pfr 1 rtL/ mflnt 

ijiidUUd i u i zuu cii, r i uyiiicii i 


155 to 278 


0 


-155 to -278 


0 


uuipUt ri uuuicu uy ru r 1 1 1 1 pun i s 










wort; Experience 


0 


0 


-9 


-9 


QJT Employment 


0 


0 


839 


839 


llncuhc ! HI70H Pninl numont 

uiidUUdiuiZvU oiipi uy men 1 


0 


0 


1541 to 2767 


1541 to 2767 


Tfly PflwoiAnt^ 

IUA rU J WON 19 










Pfiwrnl 1 Tny ac 


-141 tn -714 


*\in tn 4A9 


141 tn 714 




Income and Soles Taxes 


-226 to -383 


226 to 383 


226 to 383 


0 


Transfer Programs 










AFDC Payments 


-652 to -801 


652 to 801 


652 to 801 


0 


uiner ironsier roymenTS 


-901 tn -170 
*UI TO J/7 


on.1 tn 170 
tUl TO J/7 


Oni ♦ « 170 

iui to j/y 


n 
U 


Tronsfer Program Admini station 


0 


72 to 113 


72 to 113 


72 to 113 


fllT WnnA CiihciHiAC 

vj 1 Ha ye ouosioies 


n 
U 


1 ah 
-J40 


n 
U 


n 
U 


OJT Operating Costs 


0 


-500 


-500 


-500 


Other WIN Operating Costs 


0 


39 


39 


39 


WIN Allowances and Support Services 


-21 


21 


21 


0 


JTPA Operating Costs 


0 


-73 


-73 


-73 


Net Supervision Costs 


0 


0 






Preference for Work Over 










Welfare 0 


+ 


0 


+ 


+ 


Forgone Personal and Family 










Activities 0 




0 


0 




Net Present Value* 


971 to 1554 


601 to 1284 


939 to 1623 


1910 to 3176 



SOURCES: See Tables 5.1, 5.2 and 5.4. 

NOTES: See Table 5.5. 
0 

These are intongibie effects not meosured in this onalysis. 

b 

The net present volue is the sun of a: I gains and losses. 




of the AFDC program is a net benefit to society because taxpayers save 
money, and the welfare sample is not directly affected. Table 5.7 displays 
program effects from this perspective. 

For the early sample, society receives a net benefit of between $1,910 
and $3,176 due to net gains in value of output from OJT and unsubsidized 
employment and savings in transfer payment administration expenditures. 
These gains exceed the net present value estimates for each of the other 
three perspectives. 

VI. Generalizability of the Findings 

Benefit-cost estimates for the early sample may underestimate the 
cost-effectiveness of New Jersey's OJT prograia. As discussed in Chapter 
III, the OJT program placed a higher percentage of later-sample experimen- 
tals in OJT jobs compared to early-sample expet imentals (45 to 41 percent). 
Since the OJT program appears to benefit enrol lees by placing same of them 
in higher-paying or more stable employment than they could have found on 
their own, it can be expected that five-year earnings gains for the later 
sample will be laryer. Gains for the lull research sample should also be 
larger, but by a smaller amount. However, the short follow-up for the 
later sample makes projection of future effects highly speculative. 
Appendix Tables E. 2 to E. 4 display observed and projected benefits for the 
later sample. Equivalent estimates for the full sample can be found in 
Tables E. 5 to E. 7. 

During the Common Period (quarters t;;o through four following randan 
assignment), later-sample experimentals average $716 in earnings gains (see 
Table E. 2), about $415 more than early- sample experimentals. However, 
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savings in transfer payments were also higher by about $300. As shown in 
Table E.3, later-sample experimental receive a net gain of $185 during the 
observation period, while the budget breaks even. 

Longer-term impacts for the early sample suggest that the magnitude of 
savings in transfer payments will decay more rapidly than earnings gains. 
But the base period estimates for transfer payments capture much of the 
relatively rapid short-terra decrease and project it more than 3.5 years. 
Therefore, net gains for later-sample experiraentals ($881 to $1,459) fall 
slightly below those for the early sample. (See Table 5.7.) Net gains for 
the budget ($1,207 to $2,332) are considerably higher than those displayed 
by the early sample, however. Had the base period captured savings in 
transfer payments at a later point in time, gains for the welfare sample 
might be larger, while gains for government budgets might be smaller. 
Again, absence of follow-up prevents more definite conclusions. 

VII. Conclusions 

The New Jersey OJT program produced net gains from all perspectives 
that are measurable even when using relatively conservative assumptions 
concerning future program effects. The consistency of these estimates 
supports the conclusion that the program is cost-effective and a useful 
tool in an array of employment and training services for welfare recipients 
in New Jersey. As intended, the program helped welfare recipients find 
employment that paid better or offered more hours of work — although it 
did not increase employment rates. It is also noteworthy that state and 
local DHS and ES/WIN staff succeeded in running an OJT program, using grant 
diversion to fund employer subsidies. 
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Although these results are positive, the findings presented here, 
along with the experience of OJT programs in other states, underscore the 
difficulty of expanding OJT employment opportunities. In New Jersey as 
elsewhere, the OJT program operated on a small scale and worked with a 
select group of welfare recipients interested in on-the-job training and 
deemed employable by job developers. In this demonstration, randan assign- 
ment reduced the number of enrollees and may have curtailed the number of 
OJT placements. But the capacity of the program even to work with the 
welfare recipients most likely to benefit from eligibility for OJT 
employment stiJ 1 appears to be limited. For instance, since the end of the 
experimental phase of the program, New Jersey has averaged about 240 OJT 

placements per year, as compared to 200 per year recorded during the 
3 8 

demonstration. If the consensus among job developers interviewed for the 
evaluation is correct, n.ore funds for job development and support staff 
may increase OJT placements. However, this evaluation could not test these 
assertions. 

Finally, there is no evidence to date that demonstrates the feasi- 
bility or cost-effectiveness of making OJT employment available to the 
larger welfare population. Therefore, the OJT program is probably best 
seen as an effective but lim ited part of the state 1 s overall employment 
services for welfare recipients. 
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APPENDIX A 
HOW GRANT DIVERSION WORKS 
In New Jersey, diversion of AFDC grants and the payment of OJT wage 
subsidies require coordination among county DHS and DOL staff and central 
DOL administrators. Included in the process are ES/WIN job developers; 
Income Maintenance staff, grant diversion administrator, fiscal and data 
processing staff at County Welfare Agencies; and fiscal and administrative 
staff at the central DOL office. 

I. Notification of the Income Maintenance Unit 

When an enrol lee begins an OJT job, the job developer makes an entry 
in the On Board Sunmary Report, the OJT employment logs used in this 
report, and an ES/WIN clerk fills out a WIN Status Change Notice indicating 
that the enrol lee has begun OJT employment. (Status Change Notices are 
also used to record other WIN activities and serve as the data source for 
ESARS. ) ES/WIN sends a copy of the Status Change Notice to the County 
Welfare Agency's Income Maintenance Unit (IMU). Upon receipt of the Status 
Change Notice, IMU staff enter a new code in the enrollee's computerized 
records that designates her as an OJT employee. Job developers notify the 
IMU when the subsidy period ends, at which time the code for OJT employment 
is deleted from the welfare recipient's computerized record. Each month, 
FAMIS, the DHS computerized data base, generates a list of OJT employees, 
and county IMU staff and job developers compare the names on this list with 
the CUT employees recorded on the On-Board Summary Report. A common list 
of OJT employees is agreed upon, and grant diversion calculations are 



performed for thes<? individuals. 
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I.T. Calculations by the IMU 

All enrollees in New Jersey's OJT program receive their regular 
welfare checks while they wait for an OJT position. Once an enrollee 
begins her OJT job, New Jersey is authorized through a waiver under Section 
1115 of the Social Security Act to freeze the value of her welfare grant at 
tne amount that she received for that month. (When the value is "frozen, ■ 
the welfare agency receives the same amount of money from the state and 
federal treasury as previously to cover the individual's welfare check.) 
New Jersey then has the right to divert funds for as many months as the 
length of the OJT contract (up f o six months) — or, if the OJT employee 
quits or gets fired before the end of the contract period, for as many 
months as the OJT employee worked. 

IMTJ workers follow the same procedures for calculating an OJT 
employee's welfare grant as they do for calculating grants of any welfare 
recipient who is working. Each month, the OJT employee is required to send 
in a Monthly Status Report that includes records of her previous month's 
earnings. IMJ staff then use the value of earnings when calculating the 
following month's AFDC grant. Since it takes one month to collect earnings 
records and another month to put the recalculated grant into effect, an OJT 
employee's welfare check does not reflect her earnings until the thiid 
month following the start of her OJT job. New Jersey uses prospective 
budgeting to estimate future benefit levels and retrospective budgeting to 
recoup welfare savings for the first two months of employment, when OJT 
employees (or other welfare recipients) are working and receiving their 
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regular welfare checks. That is, the IMU continues to use the value of a 
previous month's wages co calculate the next month's AFDC grant for two 
months after the recipient leaves a subsidized OJT job or an unsubsidized 
position. 

How much AFDC income an OJT employee receives each month depends on 
the amount of wages she earns at her OJT job, the number of dependents in 
her family, and the deductions to which she is entitled under the normal 
rules fo^- calculating welfare grants. An OJT employee (like other wage- 
earners on AFDC) is entitled to a $75 per month deduction from the value of 
wagej to cover work-related expenses. She is also instructed to include in 
her Monthly Status Report records of childcare payments for the previous 
month. Up to $160 per child per month will be deducted from the value of 
earnings to cover the cost of childcare. Finally, for the first fou 
months of employment (OJT or unsubsidized), the recipient receives an addi- 
tional deduction of $30 plus one-third of the remaining value of monthly 
wages, once thcr - other deductions have been subtracted. For the remaining 
two months of a six-month OJT trial employment period, she receives a $30 
deduction. 

Once deductions are made, the value of remaining earnings is subtract- 
ed frcro the maximum welfare payment allowed to the household, and the wel- 
fare recipient receives tha difference as a residual welfare grant. If the 
value of her remaining earnings exceeds the value of the maxxmir. allowable 
paymen , or if the value of earnings prior to deductions exceeds 185 
per" if the maximun income that a person may eain and still receive 
wel , che OJT recipient receives no welfare payment. (She and her 
family remain eligible for Medicaid, however. ) The remaining portion of 
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the monthly grant — from one dollar up to the total value of the r int — 
is diverted to pay for wage subsidies. 



III. From Diverted Grant to Wage Subsidies 

Once the monthly grant diversion calculations are made, each County 
Welfare Agency issues a check for the total amount diverted to the central 
fiscal office of New Jersey DOL. In New Jersey, these funds are deposited 
in a single grant diversion account, but are designated for exclusive use 
by the county of origin. (In other words, New Jersey maintains separate 
wage subsidy pools for each county. ) The fiscal office prepares a monthly 
Grant Diversion Financial Report and sends copies to the ES/WIN central 
office and the County Welfare Agencies. Upon receipt of the Financial 
Report, the ES/WIN Coordinator sets the amount of new "obligational 
authority" for each county — i.e., the amount for which job developers may 
contract for new CJT positions, based on the *T.cunt of funds paid into the 
pool the previous month — and notifies the county ES/WIN units of this 
amount. 

Wage subsidies are financed through invoices drawn on the county wage 
poo] s. Each month, thj county job developer obtains records of wages paid 
to OJT employees and forwards the subsidy request to the central DOL fiscal 
office. DOL then sends a check for half the wages paid to the OJT 
employee. In general, it takes two c three months for an employer to be 
reimbursed. 
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TABLE B . 1 
NEW JERSEY 

SELECTED CHARACTERISTICS OF THE SHORT-TERM IMPACT SAMPLE, BY RESEARCH GROUP 



fhn rnf tp r i c t if 

L IIU 1 U l 1 C 1 15 1 1 l 


Exper (mentals 


Controls 


Total 


County (X) 








Atl on t i c 


7.9 


7 . 7 


7.8 


Burl i nntnn 


o n 
0 • U 


8 . Z 


J . 1 


Camden 

V* U III v w II 


1 7 fl 
1 L « 0 


1 7 0 

Ui7 


17 fl 


Essex 


12.7 


1 3.0 


12.8 


Hudson 


14.6 


1 3.2 


1 3.9 


Me r ce r 


1 9 S 

1 7 . J 


1 O { 
1 V • 3 


1 0 { 


Middlesex 


A A 


A fl 


4.0 


Monmou t h 


11.1 




1 1 7 


Pos so i c 


9 . 1 


9 7 

7 « L 


9 7 

7 . L 


Sex (%) 








Fema I e 


96.0 


96.6 


96.3 


Male 


4.0 


3.4 


3.7 


WIN Status (X) 








Mando t a ry 


8 2,8 


fl 7 S 

O 0 . 3 


fl 1 7 


Non-Ma nda t o ry 


17.2 


16.5 


16.8 


Age (X) 








Less than 19 Yeors 


0.2 


0.3 


0.2 


19-24 Years 


1 7 5 


l i i 

Mil 


i 7 n 


25-34 Years 


5 3.7 


4 A 4 


5 1 1 ** 

9 • . i 


35-44 Years 


2 5.4 


3 2.3 


28.8*** 


45 Yeais or More 


8. 1 


7.6 


7.9 


Average Age (Yeors) 


32.0 


32.4 


32.2 


Ethnicity (> ) 








White, Non-Hispanic 


14 


16.6 


15.6 


Black, Non-H i span i c 


72.0 


68.5 


70.3 


Hispanic 


13.0 


14.4 


1 3.7 


Other 


0.4 


0.5 


0.4 


Degree Received (X) 








None 


40.0 1 


42.0 


40.9 


GEO 


9.8 


9 (j 


9.8 


High School 0 i p 1 omo 


50.2 


48.2 


49.2 


Average Highest Grade Completed 


11.3 


1 ) .2 


11.2 



; c on t i nued ) 
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TABLE 3.1 (continued) 



Chorocterist c 


1 

Expe r i me n t a I s 


Con t ro 1 S 


Tot a 1 


Marital Status (%) 
Never Marr jed 

Married, Living with Spouse 
Married, Not Living with Spouse 
D i vorced or Wi dowed 


55. 1 
3.5 
22.8 
18.7 


.j. 4 
3.4 
23.6 
19.5 


54.3 
3.5 
23.2 
19. 1 


Any Children (X)° 
Less than 6 Years 
Be tween 6 and 18 Yea rs 


23.4 
86 


20.5 
87.8 


22.0 
86.9 


Average Number of Children 

Less than 19 Years 
Less than * Years 
Be tween 6 and 18 Yea r s 


1 .9 
0.3 
1 . 6 


1 .9 
0.3 
1 . 7 


1.9 
0.3 
1 . 6 


Prior AF DC Dependency {%) 
Never on AFDC 
Less than 4 Months 
4 Months to 2 Years 
More than 2 Years 


1 .5 
5.4 
19.3 
73.8 


0.4 
6.1 
19.9 
73.6 


0.9** 

5.8 
19.6 
73.7 


Average Number of Months on AFDC during 
Two Years prior to Random Assignment 


18.5 


18.5 


18.5 


Received AFDC during gear prior to 
Rcnticm Assignment (%) 


93.9 


93.2 


93.5 


Average Amount of AFDC Received during 
Year prior to Random Assignment ($) 


3460. 89 


3266.52 


3365. 1 6** 


Heid a Job at Any Time prior to 
Random Assignment (X) 


82.9 


80.3 


81 . 6 


Average Number of Months Employed 
during Two Years prior to Random 
Ass i gnmer t 


4.0 


3.8 


3.9 


Reported Earnings during Year 
prior to Random Assignment (%) 
None 

S1-S1000 
$1001-13000 
$3001-15000 
Over $5000 


64.4 
18. 7 
9.5 
4. 1 

3.3 


68.2 
14.7 
8.2 
5. 1 
3.8 


66.2 
1 6. 7** 

8.9 

4.6 

3.6 



( con 1 1 nued ) 
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TABLE B.I (continued) 



Characteristic 


f 

Experiments 


Controls 


Total 


For Longest Job Held during 








Past Two Years 








Average Hourly wage Rate ( ;) 


4.57 


4.55 


4.56 


Average weekly Hours 


35.0 


34.8 


34 .9 


e 

Samp l e Size 


814 


790 


1 604 



SOURCE: faiculai'ans from MDRC Client Information Sheets and New Jersey OHS 
Family Assi.ts**ce Management Information System. 

NOTES: Distributions may not add to 100.0 percent due to rounding. 

A chi-square test or t-test was applied to differences between 
research groups. Statistical significance levels are indicated as: * = 10 percent; 
** - 5 percent; *** = 1 percent. 

a 

Distributions may not add to 100.0 percent because sample members can 
have children in bath categories. 

b 

Calculations are from New Jersey DHS Family Assistance Management 
I nf o r ma t i a n System. 

C Calculatianc mc I Uv values of zero for sample members not receiving 

AFDC. 

d 

Ave'rages are for 3 7 5 expe r i me nt a I s and 339 controls. 

e 

For select ed characteristics, sample sizes may vary up ta 17 sample 
points due to missing data. 
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TABLE B.2 
NEW JERSEY 

SELECTED CHARACTERISTICS OF The FULL SAMPLE. BY RESEARCH GROUP 



Cho rocteristic 


Expei imental s 


1 

1 Controls 


1 

Total 


County (x) 












A 1 1 on 1 i c 


7 , 


9 


7 


t 1 


7 . 8 


Burl i ngton 


9 . 


1 


9 


.2 


9 . 2 


Camden 


13. 


0 


1 j 


. 0 


13.0 


Essex 


14 . 


0 


14 


. 1 


14 . 1 


Hudson 


12. 


0 


1 0 


.9 


11.5 


Me r ce r 


18. 


4 


18 


. 6 


18.5 


Middlesex 


3 . 


6 


4 


. 0 


3.8 


Monmouth 


1 1 . 


5 


1 1 


. 8 


11.7 


P 0 s s c i c 


10. 


4 


10 


. 6 


10.5 














F e in o l e 


95. 


9 


96 


. 2 


9 6.1 




4 . 


1 


3 


. 8 


3 . 9 


WIN StOtuS (X) 












Mondo tory 


81 . 


5 


82 


. 0 


81 . 7 


Non-Mondo tory 


1 8 . 


5 


1 8 


. 0 


18.3 














Less tnon 19 Yeo rs 


0. 


2 


0 


. 2 


0. 2 


iy-24 Yeo r s 


12. 


8 


1 2 


. 0 


12.4 


2 5-34 Yeors 


52. 


8 


50 


.4 


51.6 


35-44 Yeors 


26. 


6 


30 


.3 


28.4* 


45 Years c More 


7. 


6 


7 


. 0 


7 . 3 


Average Age (Years) 


32 . 


0 


32 


. 1 


32.1 


Ethnici ; (X) 












White, Non-H ispani c 


14 . 


9 


17 


.5 


16.2 


Black. Non-H Ispani c 


72. 


3 


68 


.2 


'0.3« 


H ispanic 


12. 


4 


13 


. 8 


i 3. 1 


Other 


0. 


4 


0 


.4 


0.4 


Degree Received (X) 












None 


39 . 


8 


40 


. 5 


«tU. 1 


G ED 


10. 


5 


1 1 


0 


10.7 


High School Diploma 


49. 


7 


48 


5 


49. 1 


Average Highest Grade Completed 


1 1 . 


3 


1 1 


2 


11.3 



( c or* t i nued ) 



TABLE B. 


2 ( con t i nued ) 






Choroc ter is 1 1 c 


1 

Expe r i me nto 1 s 


1 

Cont r o 1 s 


I 

Toto 1 


Moritol Stotus (X) 
Neve r Morr i ed 

Morrjed, Living with Spouse 
Morried, Not Living with Spouse 
Divorced or Widowed 


54.3 
3.6 
23. 1 
19.0 


52.4 
3.5 
24.1 
20.0 


53.4 
3.5 
23.6 
19.5 


Any Children (X)° 
Less thon 6 Yeors 
Be tween 6 c id 1 8 Yeo rs 


24 . 0 
85.6 


22.4 
87.6 


23.2 
86.6 


Averoge Number of Children 

Less thon 19 Yeors 
Less thon 6 Yeors 
Between 6 ond 18 Yeors 


2.0 
0.3 
1 .6 


1 .9 
0.3 
1 . 6 


2.0 
0.3 
1 .6 


Prior AFDC Dependency {%) 
Never on AFDC 
Lees thon 4 Months 
4 Months to 2 Yeors 
More thon 2 Yeors 


1 .8 
5.5 
18.2 
74.4 


0.7 
5 . 5 
20.8 
73.0 


1.3* 
5.5 

19.5 

73.7 


Averoge Number of Months on AFDC during 
Two Yeors prior to Rondom Assignment 


•18.5 


18.5 


18.5 


Received AFDC during Jeor prior to 
Rondom Assignment (X) 


94.0 


93.4 


93.7 


Averoge Amount of AFDC Received during 
Yeor prior to Rondom Assignment ($) b 


34 5 1 . 72 


3263.40 


3359.16** 


Held o Job ot Any Time prior to 
Rondom Assignment (X) 


84.0 


81.7 


82.9 


Averoge Number of Months Employed 
during Two Yeors prior to Rondom 
As s i gnmen t 


3.9 


3.8 


3.9 


Reported Eornings during Yeor 
prior to Rondom Assignment (X) 
None 

$1 - $ 1 00 0 
$1001-13000 
$300 1 - $5 000 
Over $5000 


64 . 6 
18.8 
9.5 
3.9 
3.3 


66.5 
14.4 
8.4 
4.9 
3.9 


66.5* 
1 6.6** 

8.9 

4.4 

3.6 



(cont mued ) 
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TABLE B . 2 ( cont inued ) 



Character i st i c 


• 

Exper i mental s 


Cont ro l s 


Total 


For Longest Jog Held during 








Post Two Years 








Average Hourly Wage Rate ($) 


4.50 


4.52 


4.5 1 


Average Weekly Hours 


34.4 


34.8 


34 .6 


Sample Size 


988 


955 


1943 



SOURCE: Calculations from MDRC Client Information Sheets and New Jersey 
DHS Family Assistance Management Information System. 

NOTES : Distributions may not add to 100.0 percent due to rounding. 

A chi-squore test or t-test was applied to differences between 
research groups. Statistical significance levels are indicated as: * = 10 
percent; ** = 5 percent; *** = 1 percent. 

a 

Distributions may not add to 100.0 percent because sample members 
con have children in both categories. 

b 

Calculations are from New Jersey DHS Family Assistance Management 
I nf armo t Ion System. 

Calculations include values of zero for sample members not 
receiving AFDC. 

d 

Averages are for 4 57 expe r i ment a I s and 415 controls. 

e 

For selected characteristics, sample sizes may vary up to 17 
som;)le points due to mi'Sing data. 
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TABLE C. 1 



OJT EMPLOYMENT RATES, NUMBER OF WEEKS TO OJT START 
AND AVERAGE LENGTH OF OJT EMPLOYMENT, BY COUNTY 
(FULL SAMPLE) 



Item 


Atlontlc 


Burl Ington 


Camden 


Essex 


Hudson 


Mercer 


Middlesex 


Monmouth 


Passaic 


Total 


Ever Employed In 
an OJ T Pas 1 1 1 on 

VM V* 1 ■ ||9 1 1 1 VII 


29 5 

47 • «J 


17 fl 


<ifl A 


47 fl 


04 . L 


17 0 


L 3 . U 


JO. 0 


00*7 


4 9 A 
44 • 0 


Ever Employed in o 
Second OJT Position 


0.0 


1.1 


2.3 


0.7 


7.6 


1.6 


0.0 


4.4 


1.9 


2.4 


Average Number of 
Weeks between Random 
Assignment and Stort 
of OJT Employment 0 


7.5 


8.8 


3.5 


3.9 


4.4 


9.5 


2.7 


9.1 


5.2 


6.0 


Average Number of 
We ks Employed in 
First OJT Position 0 


11.2 


12.2 


9.4 


12.0 


8.4 


15.9 


6.6 


8.4 


6.2 


10.5 


Somple Size 


78 


90 


128 


138 


119 


182 


36 


114 


103 


988 < 

If 



SOURCE AND NOTES: Si Table 3.1. 
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TABLE C.2 
NEW JERSEY 

ON-THE-JOB TRAINING EMPLOYMENT RATES WITHIN SELECTED SUBGROUPS 

(FULL SAMPLE) 



WlIU I Uk 1 C 1 1 J 1 1 W 


T 

Subgroup Size 


Ever Emp i oy ed i n 
on 0J T Pos i t i on 


WIN StOtUS 








Mo ndo t o ry 


one 

OU J 


4 1 


. 9% 


Non-Monda tory 


183 


4 7 


. 0 


Aqe 








Less thon 19 Yeo rs 


9 
L 


50 


.0 


19-24 Yeors 


I 2 6 


4 I 


. 1 


25-34 Yeors 


522 


A C 


. L 


35-44 Yeors 


26~ 


40 


. 7 


45 Yeors or More 


7 5 


34 


. 7 


Ethnic i ty 








Wh i te , Non-H i s pan i c 


146 


4 1 


. 8 


Black, Non-Hispanic 


7 C\9 


4 1 


. 6 


Hispanic 


1 L L 


51 


.6 


0 the r 


A 
H 


25 


.0 


Degreo Received 








None 


390 


A 1 




G ED 


1 U J 


4 1 


7 


High School Diploma 


1 P 7 


44 


. 1 


Any Child r en° 








Less thon 6 Years 


736 


47 


.0 


Between 6 and 18 Years 


841 


42 


.6 


Prior AFDC Dependency 








Never on AFDC 




33 


. 3 


Less thon 4 Months 


54 


37 


.0 


4 Months to 2 Years 


17? 


41 


. 3 


More thon 2 Years 


731 


43 


.9 


Number of Months Received AFDC 








during Yeojj prior to Random 








As s i gnmen t 








0 Months 


59 


37 


3 


1 to 12 Months 


929 


43 


2 



'continued) 
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189 



TABLE C .2 ( con t inued ) 



Characteristic 


Subgroup Size 


Ever Emp I oyed i n 
an 0JT Position 


Held a Jab at Any T i me 






prior to Random Assignment 






No 


157 


39.5 


Yes 


825 


43.5 


Reported Earnings during Year 






prior to Random Assignment 






None 


634 


45.4 


S 1 - $1 00 0 


184 


35.3 


$1 00 1 - $3000 


93 


4 7.3 


$3001-15000 


38 


34 .2 


Over $5000 


32 


3* .4 


Al 1 Exper i ment a 1 s C 


988 


42.8 



-SOURCE: Calculations from MDRC Client Information Sheets, New Jersey DHS 
Family Assistance Management Information System and New Jersey WIN Grant 
Diversion Project On Board Summary Reports, 

NOTES: °Sample sizes for Any Children add tc more than 988 because sample 
members can have children in both categories. 

b 

Calculations are from New Jersey DHS Family Assistance Management 
Information System and New Jersey WIN Grant Diversion Project On Board Summary 
Rep or t s , 

C For selected characteristics, the number of exper i me nta I s may 
vary jp to 17 sample points due to missing data. 
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TABLE C.3 



NEW JERSEY 

PERCENT INVOLVEO IN SPEC I F I EO ACTIVITIES 
WITHIN TWELVE MONTHS OF RANOOM ASSIGNMENT, BY RESEARCH GROUP 

(FULL SAMPLE) 



AC T 1 V 1 Ty McUSUic 


Expe r I me nt a 1 s 


Control s 


C i/o r Art i u a 
tvc I AC 1 1 Vc 


8 5.0% 


7 3 


. 5 X*** 


Participated in Any WIN Component 0 


82.9 


70 


. 5 *** 


Any Job Seorch 


61.5 


6 6 


. 9 * * 


Individual J ob Search 


43.5 


4 6 


. 5 


Job Develoer Contact 


19.7 


23 


. 7** 


Job Referral 


19.2 


33 


. 0*** 


o roup joo b eo r c n 


18.6 


2 2 


. 5 ** 


WIN Referral s to Tra i n i ng 


8.1 


9 


.0 


win insiiTUTionoi training 


0.3 


0 


.0 


Non-WIN Institutional Trcining b 


7.4 


7 


.2 


n a n - w in bUDsiQizea employment 


0 . 6 


1 


.8** 


Work Experience 


A 4 
o . *t 


8 


5* 


OJT Employment 


42.3 


0 


0*** 


Participated in Any JTPA Training 


18.2 


1 7 


1 


voca t i ona I Training 


13.3 


1 1 


9 


Education (Remedial or Academic} 


1.3 


1 . 


6 


Employment Pre po ration 


0.? 


1 . 


0** 


Job Search or work Experience 


5.6 


3. 


4** 


J TPA-Prov i ded OJT 


0.5 


2. 


5««« 


Dereg i s tered 


42.6 


39. 


8 


Due to Sanctioning 


5.7 


6. 


0 


Entered Employment 


64.9 


47 . 


4**» 


Samp 1 e Size 


988 


955 



SOURCE AND NOTES; 



See Table 3.3. 
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TABLE C.4 



NEW JERSEY 

PARTICIPATION PATTERNS 
WITHIN TWELVE MONTHS OF RANDOM ASSIGNMENT, 
BY RESEARCH GROUP 
(FULL SAMPLE) 



Activity Measure 


Exper Imenta i s 


Control s 


Active in: 








Job Search Only 


28 


.65 


48.5% 


Trai ni ng Oni y 


3 


. 7 


5.5 


Work Experience Only 


0 


. 5 


O.o 


OJ T Only 


15 


.3 


0.0 


Job Search and Training 


6 


.8 


11.0 


Job Search and work 








Exper i ence 


1 


6 


4.9 


Job Search and OJ T 


I 7 


. 4 


0.0 


Trai ni ng and work 








Exper i ence 


0 


1 


0.4 






A 








f 


0 . 0 


Work Experience and OJ T 


0 


5 


0.0 


Job Search. Training and 








Work Experience 


1 


3 


2.5 


Joj Search. Work Exper- 








ience and OJ T 


0. 


9 


0.0 


Jab Search. Training 








and OJ T 


3. 


8 


0.0 


Training, work Experience 








and OJT 


0. 


4 


0.0 


Al 1 Fo*T Activities 


1 . 


0 


0.0 


Never Active 


15. 


0 


26.5 


Tatal 


99. 


9 


99.9 


Sample Size 


988 


955 



SOURCE AND NOTES: See Table 3.4. 
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TABLE D.I 

NEW JERSEY 

ESTIMATED REGRESSION COEFFICIENTS OF 
EXPERIMENTAL GROUP DUMMY 





Dependent Variables 




Early Sample 


Short-Term Sample 


Ful l Sampl e 




Experimental Graup 


Exper iraenta 1 Graup 


Experimental Graup 


Regressar 


n ii m n\s 
v umwy 


n ii m mw 

V W HI III J 


n tin id v 

V U HI HI J 


Conf font 


0.51 1*** 


0. 507*** 


0.508*** 




(0.016) 


(0 013) 


(0.011) 


Regi an 








An ont i c 


0 .020 


0. 006 


0.010 




(0.068) 


(0.054) 


(0.049) 


Burl ingtan 


0 036 


-0.013 


0.015 




(0.069) 


(0.055) 


(0.048) 


Camden 


.036 


-0 . 005 


0.007 




U.065 ) 


(0.045) 


(0.042) 


Essex 


0.014 


-0. 020 


-0.011 




(0.063) 


(0.046) 


(0.041 ) 


Hudson 


0 . 047 


0.037 


0.035 




(0.078) 


(0.045) 


(0.044) 


Mercer 


— — 


— — 


— — 


Mi ddl esex 


0.056 


-0.003 


0.010 




(0.118) 


(0.067) 


(0.066) 


Manmauth 


-0.001 


-0.019 


-0.012 




(0 .063 ) 


(0.048) 


(0.044) 


Pas so i c 


0 . 060 


0.009 


0.005 




(0.073 ) 


(0.051 ) 


(0.04S) 


Age 








24 Years ar Less 


0.057 


0.020 


0.019 




(0.057 ) 


(0.048) 


(0.042) 


25 ta 29 Years 








30 Years ar Mare 


0.020 


-0.031 


0.007 




(0.040 ) 


(0.031 ) 


(0.028) 



( conti nued) 
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TA8LE 0.1 (continued) 





Dependent Voi iobl es 


Regressor 


Eor 1 y Sompl e 
Experimental Group 
Dummy 


Short-Term Somple 
Experimental Group 
Dummy 


Fui 1 Sompl e 
Exper imentoi Group 
Dummy 


Number of Children 
One 


0 

(0 


.002 
.040) 


-0 
(0 


015 
030) 


0.008 
(0.028) 


Two 












Three or More 


-0.008 
(0.044 ) 


0 

(0 


013 
033 ) 


-0.004 
(0.031 ) 


Received AFOC for 
More thon Eight 
Quorters prior to 
Rondon Assignment 


0 
(0 


.006 
.040) 


0 
(0 


006 
.031 ) 


0.001 
(0.029) 


Total AFOC Received 
during Four Quarters 
prior to Random 
Ass i gnment 


0 
(0 


.000 
.000) 


0 
(0 


000 
000) 


0.000*** 

(0.000) ■ 


Earned Zero Ool 1 ors 
during Four Quarters 
prior to Random 
Assi gnment 


-0 
(0 


.1 24*** 

.041 ) 


-0 

(0 


078** 

035 ) 


-0.095*** 

(0.032) 


Eornings Greoter thon 
$1000 dur 1 ng Four 
Quorters prior to 
Rondom Assignment 


-0 
(0 


.128** 

.055 ) 


-0 
(0 


065 
044 ) 


-0.048 
(0.041 ) 


Not WIN Mandotory 


-0 
(0 


.098** 
.047 ) 


-0 
(0 


022 
040) 


-0.013 
(0.035) 


Owns a Cor 


-0.006 
(0.045) 


0 
(0 


053 
037 ) 


0.022 
(0.033) 


No High School 
Oegree 


0 
(0 


.009 
.033 ) 


-0 
(0. 


020 
026 ) 


-0.009 
(0.024) 



( cont i nued) 
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TABLE D . 1 (continued) 





Dependent var 1 ab' es 


Regressor 


Ea r 1 y Sampl e 
cxperiroenroi « r o u p 
Dummy 


Short-Term Sampl e 
experimental uroup 
Dummy 


Ful 1 Sampl e 
ca pe r i me n i a i uroup 
Dummy 


Never Married 


0. 004 
(0.038) 


0.002 
(0.030) 


0 .003 
(0.027 ) 


Black 


0.050 
(0.039) 


0.048 
(0.031 ) 


0.051 • 
(0.028) 


Mai e 


- n n fl 9 
(0.082 ) 


n nit 
(0.068) 


n n n i 
(0.061 ) 


Randoml y Ass 1 gned 
between 

October 1984 and 


-0.009 
(0.056) 




-0.004 
(0.048) 


January 1 985 and 

Mn rrh 1 Oft 5 

JHU 1 VII 1 704 


0.026 

(n n i 7 ) 
I U . U 4 / J 


a 


0.020 
In n i fl \ 


Aor M 1 985 and 
June 1985 


_ n n o i 
U • U a 4 

(0.044) 


_a 


- n nil 

U • U 1 4 

(0.035) 


Number of 

UU99I ¥ SJ 1 1 U It ) 


994 


1604 


1943 


Number of 

Exni r 1 oa n tfl 1 s 

• AU« 1 1 INv M 1 v 1 9 


3 U O 


0 1 4 


O ft ft 
7 0 0 


Number of Controls 


1 ft k 
4 0 0 


7 o n 
/ 7 U 


0 c c 

73 9 


Dearees of Freedom 
for Error 


O X ft 
TOO 


1 C ft 1 


17 1/ 


Error Mean Sauore 


0.25097 


0.25141 


0 .25056 


R-Square 


0.0219 


0.0085 


0.0109 


Mean of Dependent 
Var iabl e 


0.5 1107 


0 ,507 48 


0.50849 


F-StOtl StiC 


G.866 


0.620 


0.844 


P-Value of 
F-Statl sti c b 


0.655 


0.913 


0.68/ 



(continued) 
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TABLE D.I (continued) 



SOURCE: MORC calculations from New Jersey AF DC and Unemployment insurance 
earnings records. 

NOTES 2 The dependent variable in each regression equalled 1 far exper i sent ol s 
and 0 for controls. Each independent variable was measured in standard deviation 
units. Standard errors af coefficients are indicated with parentheses. 

A two-toiled t-test was applied ta each coefficent estlaate. Statis- 
tical significance levels ore indicated as: * * 10 percent; •* = 5 percent; *** * 1 
percent. 

°Charocter istics that had na variation In a subsample were aaitted 
fran regressions for thot subsample. 

b 

The p-value of the F-stotistic is the probability af obtaining these 
coefficients, if the true chance of becoming an experimental did nat vary with any 
characteristic. Thus, the closer the p-value is to unity, the more successful was 
random assignment in equating characteristics af experiments s ond controls. 



ERLC 



107 

-156- 



V 



TABLc 0.2 (continued) 





Oependent vcrlobles 


Regressor 


Early Sample 
Totol Eornings, 
Quarters 5-7 


Early Sample 
AFOC Income* 
Quarters 5-8 


Short-Term Sample 
Totol Earnings. 
Quarters 1 - 4 


Sho» f-Term Sample 
AFOC Income. 
Quarters 1 - 4 


Age 

24 Years or Less 


-451.91 
(443.95) 


195.58 
(218.10) 


-273.37 
(386.87) 


48.89 
(128.45) 


25 to 29 Yeors 








— 


30 Yeors or More 


627.05** 
(308.96) 


-234.45 
(151.78) 


-68.86 
(250.06) 


-P3.90 
(83.02) 


Number of Children 
One 


365.59 
(309.16) 


-579.36*** 
(151.88) 


109.79 
(247.80) 


-635.44*** 

(82.27) 


Two 










Three or More 


514.77 
(339.31) 


11.02 
(166.69) 


99.57 
(270.57) 


757.35*** 
(89.83) 


Received AFOC for 
Mere than Eight 
Quarters prior to 
Random Assignment 


5.40 
(309.22) 


-86.30 
(151.91) 


-432.21* 
(256.23) 


232.17*** 
(85.07) 


Totol AFOC Received 
during Four Quarters 
prior to Rondom 
Assignment 


-0.20** 

(0.09) 


0.27*** 

(0.05) 


-0.03 
(0.04) 


0.09*** 

(0.01) 


Eorned Zero Dol lors 
auring Four Quarters 
prior to Random 
Assignment 


-122.97 
(317.74) 


169.97 
(156.09) 


-52.54 
(286.18) 


51.48 

(95.01) 


Eornings Greater thon 
$1000 during Four 
Quarters prior to 
Rondom Assignment 


-122.79 
(429.00) 


356.16* 
(210.76) 


269.42 
(360.79) 


-257.11 ** 
(119.79) 



(continued) 
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TABLc 0.2 (continued) 





Oependent vcrlobles 


Regressor 


Early Sample 
Totol Eornings, 
Quarters 5-7 


Early Sample 
AFOC Income* 
Quarters 5-8 


Short-Term Sample 
Totol Earnings. 
Quarters 1 - 4 


Sho» f-Term Sample 
AFOC Income. 
Quarters 1 - 4 


Age 

24 Years or Less 


-451.91 
(443.95) 


195.58 
(218.10) 


-273.37 
(386.87) 


48.89 
(128.45) 


25 to 29 Yeors 








— 


30 Yeors or More 


627.05** 
(308.96) 


-234.45 
(151.78) 


-68.86 
(250.06) 


-P3.90 
(83.02) 


Number of Children 
One 


365.59 
(309.16) 


-579.36*** 
(151.88) 


109.79 
(247.80) 


-635.44*** 

(82.27) 


Two 










Three or More 


514.77 
(339.31) 


11.02 
(166.69) 


99.57 
(270.57) 


757.35*** 
(89.83) 


Received AFOC for 
Mere than Eight 
Quarters prior to 
Random Assignment 


5.40 
(309.22) 


-86.30 
(151.91) 


-432.21* 
(256.23) 


232.17*** 
(85.07) 


Totol AFOC Received 
during Four Quarters 
prior to Rondom 
Assignment 


-0.20** 

(0.09) 


0.27*** 

(0.05) 


-0.03 
(0.04) 


0.09*** 

(0.01) 


Eorned Zero Dol lors 
auring Four Quarters 
prior to Random 
Assignment 


-122.97 
(317.74) 


169.97 
(156.09) 


-52.54 
(286.18) 


51.48 

(95.01) 


Eornings Greater thon 
$1000 during Four 
Quarters prior to 
Rondom Assignment 


-122.79 
(429.00) 


356.16* 
(210.76) 


269.42 
(360.79) 


-257.11 ** 
(119.79) 



(continued) 
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TABLE 0.2 (continued) 





Oependent Variables 


Regressor 


Early Sample 
Total Earnings, 
Quarters 5-7 


Early Sample 
AFOC income, 
Quarters 5-8 


Short-Term Sample 
Total Earnings, 
Quarters 1 - 4 


Short-Term Sample 
AFOC Income, 
Quarters 1 - 4 


Not WIN Honda Tory 


1324.4 8*** 
(362.20) 


-3.55.49** 
(li'7.94) 


589.65* 
(324.95) 


-89.72 
(107.89) 


0*ns o Cor 


1042.96*** 

(348.37) 


-507.64*** 
(171.15) 


1361.41*** 

(302.49) 


-149.74 
(100.43) 


No High School 
Oegree 


-415.04 

(256.32) 


263.53** 
(125.92) 


-1086.41*** 

(212.25) 


144.16** 

(70.47) 


Never Married 


337.89 
(291.19) 


323.14** 
(143.05) 


-710.19*** 
(243.08) 


73.66 
(80.71) 


Black 


-469.67 
(299.23) 


286.79* 
(147.01) 


392.51 
(253.08) 


99.91 
(84.03) 


Male 


1546.68** 
(634.92) 


-362.88 
(311.92) 


889.06 
(556.06) 


175.09 
(184.62) 


Raidoaly Assigned 

between 
October 1964 and 
December 1984 


286.72 
(434.61) 


-12C.65 
(213.51) 


_a 


_a 


January 1985 and 
March '985 


-224.82 
(364.65) 


-25.97 
(179.14) 


— a 


_a 


April 1985 and 
June 1985 


Ail j A 

-Z41 .49 
(339.14) 


71.69 
(166.61) 


a 


Q 


Number of 

Observations 


994 


994 


1604 


1604 


Nunber of 
Experimental s 


508 


508 


814 


814 


Nunber of Controls 


486 


486 


790 


790 



(continued) 
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TABLE D.2 (continued) 





Dependent Voriobles 


Regressor 


Eorly Sample 
Totol Earnings* 
Quarters 5-7 


Eorly Sample 
AFDC income* 
Quarters 5-8 


Short-Term Sample 
Total Eornings, 
Quarters 1 - 4 


Short- Tern Sample 
AFDC Income* 
Quarters 1 - 4 


Degrees of Freedom 
for Error 


967 


967 


1580 


1580 


Error Meon Square 


14973831.34 


3613888.78 


16661311.13 


1836618.49 


R- Square 


0.0917 


0J667 


0.0701 


0.2542 


Mean of Dependent 
variable 


3398.45 


2062.12 


3187.67 


3234.91 



SOURCE: MDRC coiculotions from New Jersey AFDC and Unemployment Insuronce eornings 
records. 

NOTES: Cr vi nary least squares regression coefficients In this toble correspond to Impact 
estimates presented In Tables 4.6, 4.8. 4.2. and 4.3. An analysis of covarlonce procedure was 
used to control for differences In characteristics before random assignment. See 
Ostle (1975, p. 461). Standard errors of coefficients are Indicated with porentheses. 

These calculations Include sample members not employed and senile members not 
receiving AFDC. 

A two-tailed t-test wos applied to each coefflcent estimate. Statistical 
significance levels are Indicated as: * * 10 percent; ** * 5 percent; *** • 1 percent. 

a 

Characteristics thot hod no variation in a subsample were omitted 
from regressions for that subsample. 
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TABLE 0.3 



NEW J ERSE Y 

COMPARISON OF TOTAL EMPLOYMENT AND OJ T EMPLOYMENT OF EXPER I MENTAL S 

(SHORT-TERM IMPACT SAMPLE) 



Fol 1 ow-Up Per i od 


Al 1 Empl oy ed 
Exper imenta 1 s 


Experimental s 
Empl oy ed in an 
OJ T posi tlon 


Exper Imenta 1 s 
Empl oyed i n an 
OJ T Pos i t i on as 
a Percent of 
Al I Empl oy ed 
Experimental s 


Number Percent 


Number Percent 


Quarters 
Quarters 2-4 


oil 82.6 
620 76.2 


366 45.0 
260 31.9 


54.5 
41 .9 


Quarter of 

Random Assignment 
Quarter 2 
Quarter 3 
Quarter 4 


455 55.9 
506 62.2 
454 S5.8 

456 56.0 


275 33.8 
229 28.1 
98 12.0 
45 5 .5 


60.4 
45.2 
21 .6 
9.9 


Sample Size 


814 100.0 


369 45.3 





SOURCE : MDRC calculations from New Jersey WIN Grant Diversion Project On 
Board Summary Reports. 

NOTFS : 369 of the 81' exper I men t a I s randomly assigned between April 1 985 and 
June 1986 were employed in at least one OJ T position. 

The employment rates for All Employed Exper Imental s are not 
regression-adjusted. They, therefore/ dlf fer slightly from the regression- 
adjusted employment rates displayed in Table 4.2. 
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TABLE 0.4 



NEW JERSEY 

IMPACTS ON QUARTS OF INITIAL EMPLOYMENT AFTER RAN OOM ASSIGNMENT 

(SHORT-TERM IMPACT SAMPLE) 



Outcome and Fallaw-Up Period 


Exper imenta 1 s 


Cant ral s 


01 1 f erence 




p 


First Enpl ayed dur i ng 












Quorters ' - 4 


82. U 


74. 7% 


7.4X*** 


0. 


000 


First Employed during 












Quarter of Random Assignment 


55 .4 


40 . 1 


15.3*" 


0. 


000 


Quarter 2 


17.2 


!8. 1 


-0.9 


0. 


652 


Quarter 3 


5.5 


10.0 


-4.4*** 


0. 


001 


Quarter 4 


4.0 


6.5 


-2.6** 


0. 


021 


Sam pJ e Size 


814 


7 90 









SOURCE: MORC calculations from New Jersey Unemployment Insurance er.nlngs 
records. 

NOTES: Experimental and control group averages are regression-adjusted using 
ordinary leost squares, controlling far pre-random assignment characteristics af 
sample members (see Appendix Table 0.2). Th re may be discrepancies in sums ond 
differences due to rounding. 

A two-tailed t-test was applied to each difference between experi- 
mental ond control groups. The column labeled "p - is the statistical significance 
level of the difference between experimental and control averages. Statistical 
significance levels are indicated as: * = 10 percent; ** * 5 percent; *** = 1 
percent. 
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TABLE D.5 



NEW JERSEY 

EMPLOYMENT AND EARNINGS OUTCOMES AMONG EMPLOYED SAMPLE MEMBERS 





( SHORT-TERM 


IMPACT SAMPLE) 










Outcome and 


Fal low-Up Peri ad 


1 

Exper imento 1 s 


Control s 


Di f f erence 




? 


Average Number of Quarters with 












Enpl ayment , 


Quarters 1 - 4 


2.79 


2.57 


0.21*** 


0 . 


001 


Average Total Earnings, 












Quarters i - 


4 ($) 


427 1 .08 


3827 . 39 


443.69* 


0. 


066 


Average Earnings ($) 












Quarter of 


Random Ass 1 gnment 


86?. 73 


890.20 


-27.47 


0. 


730 


Quarter 2 




1479.63 


1438.9? 


40.84 


0. 


642 


Quarter 3 




1822.11 


1707 .06 


115.05 


0. 


229 


Quarter 4 




19* *.77 


1770.08 


I 94.68" 


0. 


046 


Sample Size, 


Quarters 1 - 4 


672 


586 










Quorrer 1 


455 


312 










Quarter 2 


506 


382 










Quorter 3 


454 


398 










Quarter 4 


456 


419 









SOURCE: MDRC calculations from New Jersey Unemployment insurance earnings 
records. 

NOTES: Sample members were excluded from calculations for periods during which 

they had no earnings. 

Experimental and control group overages ore regression-adjusted using 
ordinory least squares, controlling for pre-rondam assignment characteristics af 
somple members (see Appendix Tabl* D.2). There may be discrepancies in sums and 
differences due to rounding. 

A two-tailed t-test was applied to each difference between experi- 
mental ond control groups. The cciuisn labeled °p° is the statistical significance 
level af the difference between experimental ond control overages. Statistical 
significance levels ore indicated as: * - 10 percent; ■ 5 percent; ••• - 1 
percent. 
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TABLE D.6 



NEW JERSEY 

DISAGGREGATION OF CUMULATIVE EARNINGS IMPACT, 
QUARTERS ONE THROUGH FOUR 
(SHORT-TERM IMPACT SAMPLE) 



Propor t ioi of Impoc t 


Proport ion of Impact 


Proport ion of Irmact 


due to Dlf ference 


due to Differ enc e 


due to D I f f e rence i n 


i n C umu 1 o t 1 v e 


in Number of Quarters 


Av erage Ea rn i ngs pe r 


Empl oyment Rotes 


with Emp 1 oyme nt 


Employed Quarter 


S3.SX 


38.4% 


8. 1% 



SOURCE: MDRC calculations from New Jersey Unemployment 
Insurance earnings .ecords. 

NOTES: The cumulative earnings impact disaggregated here was 
presented in Table 4.2. The method for this disaggregation is 
explained in Auspos, cave and Long (1988, Appendix 0). 

o 

Differences in Average Earnings per Employed Quarter 
may result from higher hourly wages, more hours worked per week or 
more weeks worked per quarter. MORC lacked data to disaggregate 
earnings further. 



205 

-164- 



TABLE 0.7 



NEW JERSEY 

DISAGGREGATION OF CUMULATIVE EARNINGS IMPACT. 
QUARTERS FIVE THROUGH SEVEN 
(EARLY SAMPLE) 



Proport Ion of Impoct 


Prcpartian af impact 


Proport ion of Impact 


due to Difference 


due to Di f f erence 


due to Oifference in 


in Cumulative 


in Number of Quarters 


Average Earnings per 


Emp 1 oy men t Ro t cs 


wi th Empl oyment 


Emp 1 oyed Quarter 


2 1 . IX 


-23.7% 


1 02.6% 



SOURCE: MDPC calculations from New Jersey Unemployment 
Insurance earning: records. 

NOTES: The cumulative earnings impact disaggregated here was 
presented in Table 4.6. The method for this disaggregation is 
explained in Auspos, live and Lang (1988, Appendix 0). 

a 

Oifferences in Average Earnings per Employed Quarter 
may result from higher hourly wages, mare hours worked per week or 
mere weeKs worked per quarter. MDRC lacked data to disaggregate 
earnings further. 
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TABLE E. 1 



NEW JERSEY 

FROM THE PERSPECTIVES OF WELFARE RECIPIENTS AND GOVERNMENT BUDGETS: 

ESTIMATED GAINS AND LOSSES PER EXPERIMENTAL OVER FIVE YEARS, 
ASSUMING NO FURTHER BENEFITS OR COSTS AFTER THE OBSERVATION PERIOD 

(EARLY SAMPLE) 



Component of Anolysis and Perspective 


Est i mate 


Wei fore Rec i pi ent s 




Gains 




Earnings and Fringe Benefits 




OJ T Emp 1 oy me n t 


$7 7 9 

v § t 7 


Unsubsi dized Empl oyment 


L L 1 


Losses 




Income* Soles and Payroll Taxes 


1 4 J 


AF DC Pay me n t s 


— 4 fl C 
4 0 5 


Other Tronsfer Payments 


»42 


WIN Allowances and Support Services 


-21 


o 

fie t Present Value 


J U 7 


Government Budgets 




Golns 




Pay rol 1 Taxes 


$140 


Income ond Sai es Taxes 


79 


AFDC Payments 


485 


Other Tronsfer Payments 


42 


Transfer Program Admi nl strati on 


27 


Other win Operating Casts 


39 


WIN Allowances and Support Services 


21 


Losses 




OJ T wage Suds Idles 


-348 


OJ T Operati ng Costs 


-500 


J TPA Opera ti ng Costs 


-73 


o 

Net Present Vni ue 


-86 



SOURCE: See Tables 5.1, 5.2. and 5.4. 

NOTES: All benefits and casts are estimated far a five-year time 
period beginning at random assignment and are expressed In 1986 dollars. 
Because of rounding, detail may not sum to totals. 

°The net present voiue'ls the sum of all gains ond losses. 
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TABLE E.2 



NEW J ERSE Y 

ESTIMATED BENEFITS DURING THE OBSERVATION PERIOD, 
PROJECTION PERIOD, AND OVER FIVE YEARS AFTER RANDOM ASSIGNMENT, 

PER EXPERIMENTAL 
(LATER SAMPLE) 





o 

Observation Period 


Pro) ect i on Period 


1 

Ct\, A V a fx r Tm f a 1 

rive year iotui 


Benef 1 t vor lobl e 


C omnfl n 

Fol 1 aw- up 


Add I tin nn 1 

Fol 1 aw-up 


P r o 1 Aft 

■I U| Ol 1 

Base 


ft n Prn i ar t aH 
UN r I U | U L 1 c U 

Amoun t 


(Observed Plus 
Pro j ected) 


Eornings and Fringe 
Benef 1 1 s 

OJ T Empl ayment 
Unsubsidized 
Empl oy oient 


$812 
-96 


$39 

239 


$0 

238 


$0 

1654 to 3 166 


$85 1 
1797 to 3309 


Pay r ol 1 Toxes 


54 


21 


17 


122 to 232 


197 to 307 


Income and Sales Taxes 


38 


23 


16 


111 to 219 


173 ta 281 


AFDC Payments 
Regul ar 
Diverted 


-442 
420 


-66 

20 


-51 
0 


-315 to -626 
0 


-823 to -1 134 
441 


Other Transfer 
Payment s 


-105 


-5D 


-62 


-432 to -855 


-587 ta -1D1D 


Transfer Program 
Adm i ni s t ro 1 1 on 


-24 


- 9 


-12 


-79 to -160 


-112 ta -193 


SOURCE: see Tobies 5.1 and 


5.2. 









NOTES: Because of rounding, detail moy not sum to totals, 
o 

Bosed an available fallow-up data. 

b 

The projection base period Is a quarterly overage af the last two 
quarters af available fallow-up. Progran effects observed during this base period 
are multiplied by a projection factor ta estimate benefits from the end af the 
observation period ta five years from the paint 0 f random assignment. 

C The first number of each range assumes o straight line decay of 
impacts to $0 by the end of the five-year period; the second number assumes that the 
most recent program effects continue far each remaining quarter of the five-year 
per I ad. 
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TABLE E.3 



NEW JERSEY 

FROM THE PERSPECTIVES OF WELFARE RECIPIENTS ANO GOVERNMENT BUOGETS: 

EST I MATEO GAINS ANO LOSSES PER EXPERIMENTAL OVER FIVE YEARS* 
ASSUMING NO FURTHER BENEFITS OR COSTS AFTER THE OBSERVATION PERIOO 

(LATER SAMPLE) 



Component of Analysis and Perspective 


Estimate 


Wei fore Rec i pi ents 




Gai ns 




Eornings and Fringe Benefits 




OJ T Em p 1 oy men t 


$85 1 


Unsubsidized Employment 


143 


Losses 




Income, Soles and Payroll Taxes 


-124 


AFOC Payments 


-508 


Other Transfer Payments 


-155 


WIN Allowances and Support Services 


-21 


Net Present Vol ue° 


185 


Government Budgets 




Goi ns 




Payroll Taxes 


$138 


1 ncome ond Sa 1 es Taxes 


62 


AFOC Payments 


508 


Other Transfer Payments 


155 


Transfer Program Administration 


33 


Other WIN Operating Casts 


43 


WIN Allowances ond Support Services 


21 


J TPA Operotl ng Casts 


13 


Losses 




OJ T woge Subsi dies 


-380 


OJ T Operating Costs 


-546 


Net Present Vol ue° 


48 



SOURCE: See Tobies 5.1, 5.2, ond 5.4. 

NOTES: All benefits ond costs ore estimated for o five-yeor time 

period beginning ot random assignment and ore expressed in 1986 dollars. 
Because of rounding, detail may not sum to totals. 

a 

The ne f present value is the sum of oil gofns ond losses. 
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TABLE E.4 
NEW JERSEY 

ESTIMATED BENEFITS AND COSTS PER EXPERIMENTAL OVER FIVE YEARS* 
BY RESEARCH GROUP AND ACCOUNTING PERSPECTIVE 
(LATER SAMPLE) 



Comoonent of Anal vs is 


Account! np Perspectives 


Wel f a r a Sam Dl a 


Q ii HflA t 
OUUJjv 1 


Tn vnnu pr 

1 U ApU J CI 


Crtf I a fV 
^Uk i v 1 jr 


Eorni ngs 










OJ T Employment 


$759 


$0 


$-759 


$0 


Unsubsldlzed Employment 


1603 to 2951 


o 


-1603 ta -2951 


o 


Fringe Benef i ts 










OJ T Employment 


92 


0 


-92 


0 


Unsubsldlzed Employment 


194 to 357 


0 


-194 to -357 


o 


Output Produced by Participants 










Work Experience 


0 


c 


-38 


-38 


OJ T Empla/ment 


0 


0 


916 


911 


Unsubsldlzed Employment 


0 


0 


1934 to 3561 


1934 to 3561 


Tax Payments 










Payroll Taxes 


-164 to -255 


360 to 563 


164 ta 255 


0 


Income and Sales Taxes 


»173 to -28t 


173 ta 281 


173 to 28t 


0 


Transfer Pragrans 










AFOC Payments 


-823 to -1134 


623 to 1 134 


823 ta 1134 


o 


Other Transfer Payments 


-587 to -1010 


587 ta 1010 


587 to 1010 


0 


Transfer Program Administration 


0 


112 ta 193 


112 to 193 


112 ta 193 


OJ T Wage Subsidies 


0 


-380 


0 


0 


OJ T Operating Costs 


0 


-546 


-546 


-546 


Other WIN Operoting Casts 


0 


43 


43 


43 


WIN Allowances and Support Services 


-21 


21 


21 


0 


JTPA Operating Costs 


0 


13 


13 


13 


Net Supervision Costs 


0 


0 






Preference for Work Ov?r 










wel fore 0 




C 


+ 


+ 


Forgone Personal and Family 










Activities 0 




0 


0 




Net Present Value 1 * 


881 to 1459 


1207 to 2332 


1554 to 2684 


2435 ta 4142 



SOURCES: See Tobies 5.1, 5.2 and 5.4. 

NOTES: See Table 5.5. 
a 

These ore intongible effects not measured in this analysis. 

b 

The net present value is the sum of all gains and losses. 
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TABLE E.5 



NEW JERSEY 

ESTIMATED BENEFITS DURING THE OBSERVATION PERIOD, 
PROJECTION PERIOD, AND OVER FIVE YEARS AFTER RANDOM ASSIGNMENT, 

PER EXPERIMENTAL 
(FULL SAMPLE) 





o 

Observot I on Per I od 


i 

Proj ecti on Peri od 


Five Yeor 


Totol 


Benef i t Vor I obi e 


Common 
Fol i ow-up 


Addi t i onol 
Foi 1 ow-up 


Pro| ec t 
Bose 


on Pr oi ected 
Amount 


(Observed Pius 
Pro) ected) 


Eornings ond Fringe 
Benef i t s 

OJ T Empl oymen t 
Unsubsi duzed 
Empi oyment 


$760 
-245 


$54 

376 


$0 

233 


$0 

1444 to 2851 


$814 

1575 to 


2 982 


Poy rol i Toxes 


39 


33 


1 7 


1 08 to 2 1 3 


J80 to 


285 


income ond Soles Toxes 


17 


48 


21 


131 to 266 


196 to 


330 


AFDC Poyments 
Regui or 
Diver ted 


-348 
369 


-130 
26 


-46 

0 


-247 to -505 
0 


-724 to 
395 


-983 


Other Tronsfer 
Payments 


-42 


-51 


-46 


-284 to -605 


-376 to 


-697 


Transfer Progrom 
Adn»!ni stroti on 


-5 


-21 


-11 


-62 to -129 


-88 to 


-155 


SOURCE: See Tobies 5. 1 ond 


5.2. 











NOTES: Becouse of rounding, detoil tnoy not sum to totols. 
o„ 

Bosed on ovoiiobie follow-up doto. 

b 

The projection bose period is o quorterly overoge of the lost two 
quorters of ovoiiobie follow-up. Program effects observed during this bose period 
ore multiplied by o projection foctor to estimote benefits from the end of the 
observotion period to five yeors from the point of rondom osslgnment. 

C The first number of eoch ronge ossuaes o stroight line decay of 
Impocts to $0 by the end of the flve-yeor period; the second number ossumes thot the 
most recent progrom effects continue for each remoining quorter of the five-yeor 
per I od. 
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TABLE E.6 



NEW JERSEY 

FROM THE PERSPECTIVES OF WELFARE RECIPIENTS AND GOVERNMENT BUDGETS: 



ESTIMATED GAINS AND LOSSES PER EXPERIMENTAL OVER FIVE YEARS, 
ASSUMING NO FURTHER BENEFITS OR COSTS AFTER THE OBSERVATION PERIOO 

(FULL SAMPLE} 


Component of Analysis and Perspective 


1 

Estimate 


Wei fare Rec i pients 




Gal ns 

Earnings and Fringe Benefits 
OJ T Empl ayment 
Unsubsi dized Empl ay men r 


$814 

131 


Lasses 

Income, Sales and Payroll Taxes 

AFDC Payments 

Other Transfer Payments 

WIN Allowances and Support Services 


-124 
-478 
-93 
-21 


Net Present Vol ue° 


229 


Government Budgets 




Gai ns 

Pay ral 1 Taxes 

Income ond Sal es Taxes 

AFDC Payments 

Other Transfer Payments 

Transfer Program Administration 

Other WIN Operating fasts 

WIN Allowances ond Support Services 


$132 
64 
478 

93 
26 

A 1 

4 1 

21 


Losses 

OJ T wage Subsi dies 
OJ T Operat i ng Costs 
J TPA Operat i ng Cost" 


-363 
-522 
-31 


Net Present Vol ue° 


-62 


SOURCE: See Tables 5.1, 5.2, and 5.4. 




NOTES: All benefits and casts are estimated far 
period beginning ot random assignment and ore expressed 
Because af rounding, detail may not sum to totals. 


0 five-year tire 

1 n 1986 dal 1 ors. 



The net present value is the sum of all gains and lasses. 
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TABLE E.7 



NEW J ERSEY 

ESTIMATED BENEFITS AND COSTS PER EXPERIMENTAL OVER FIVE YEARS, 
BY RESEARCH GROUP AND ACCOUNTING PERSPECTIVE 
(FULL SAMPLE) 



Component of Anolysls 


Accounting Perspectives 


Welfare Sample 


budget 


Toxpoyer 


Society 


Earnings 










OJT Employment 


$726 


$0 


1-726 


$0 


Unsubsi dized Employment 


1405 ta 2660 


0 


-1405 to -2660 


0 


Fringe Benef its 










OJT Employment 


88 


0 


-88 


0 


Unsubsidized Employment 


170 to 322 


0 


-170 to -322 


0 


Output Produced by Porticiponts 










Work Experience 


0 


0 


-23 


-23 


OJT Employment 


0 


0 


876 


876 


Unsubsidized Employrr^nt 


0 


0 


1*95 to 3209 


1695 to 3209 


Tax Payments 










Payroll Taxes 


-150 to -237 


330 to 522 


150 to 237 


0 


Income ond Soles Toxes 


-196 to -330 


196 to 330 


196 to 330 


0 


Transfer Programs 










AFDC Payments 


-724 to -983 


724 to 983 


724 to 983 


0 


Other Transfer Payments 


-376 to -697 


376 to 697 


376 to 697 


0 


Transfer Program Administration 


0 


88 to 155 


88 to 155 


88 to 155 


OJT Wage Subsidies 


0 


-363 


0 


0 


OJT Operating Costs 


o 


"522 


-522 


-572 


Other WIN Operating Costs 


0 


41 


41 


41 


WIN Allowances and Support Services 


-21 


21 


21 


0 


JTPA Operoting Costs 


0 


-31 


-31 


-31 


Net Supervision Costs 


0 


0 






Preference for Work Over 


» 








Wei fore 0 




0 


+ 




Forgone Petsonol ond Family 










Activities 0 




0 


0 




b 

Net Present Value 


921 to 1527 


859 to 1832 


1202 to 2178 


2124 to 3705 



SOURCES: See Tobies 5.1, 5.2 and 5.4. 

NOTES: See Tobl e 5.5. 
o 

These are intongible effects not measured in this anoiysis. 

b 

The net present voiue Is the sum of oil go ins ond losses. 
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CHAPTER I 



1. Grant diversion can be used to fund different types of pro- 
grams, and funding sources other than AFDC can be used. For 
example, Supported Work, a federally funded demonstration th*t 
provided paid work experience jobs to AFDC recipients and 
other disadvantaged groups, also used grant diversion in sane 
sites, including Newark, New Jersey. Other programs funded 
wholly or in part through grant diversion include an OJT 
program for recipients of Heme Relief in New York state and 
programs serving recipients of Aid to the Disabled ( the 
predecessor of Supplemental Security income). see Hollister 
et al., 1984; Shapiro f 1978; and Bangser et al., 1986. 

2. see Bangser et al. , 1986, for the history of the six-state 
grant diversion project; and Auspos et al., 1988, for an 
evaluation of Maine's OJT demonstration. 

3. New Jersey estimated it would spend $800,000 per year in 
diverted welfare grants to finance wage subsidies and another 
$250,000 a year for administration and evaluation research. 
The r^dcral grant covered less than half of the cost of 
administering the program. 

4. Camden County, which is also studied in this report, has an 
unemployment rate lower than the state average, although most 
of the welfare population lives in the economically worse off 
city of Camden. 

5. If the program placed a low percentage of members of the pool 
in OJT positions, or if members of the pcol had long waits 
before employment in an OJT position, short-term employment 
and earnings gains may not occur. 

6. See pp. 157-93, Barncw, 1987; Ketron, Inc., 1980. By compari- 
son, in the New Jersey experimental design, all sample members 
were sufficiently interested in the program to apply for 
admission, and all were judged by job developers to be 
appropriate candidates for C7T employment. 

7. See Auspos et al., 1988. 

8. Burtless, 1984. 
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CHAPTER II 



1. Initially, some counties sent letters to recipients announcing 
the ava . lability of OJT. However, these recipients still had 
to go through or ientation/ appraisal before applying for the 
OJT program. 

2. See Bar and Ellwori, 1983, for example. 

3. Randan assignment took place within the individual county 
offices. The sample members in each county therefore had a 50 
percent chance of becanlng either an experimental or control. 

4. Calculations f±om WIN aggregate data based on New Jersey ESARS 
(FY 1985). 

5. A few pieces of demographic information were missing for 20 
sample members. For the Impact analysis, the modal values for 
similar sample members (that is, enrollees with the same WIN 
status within the same region) were substituted for these 
missing observations. 

6. The reliance on administrative records to measure outcomes 
offers many advantages as well as some limitations. Since 
research based on administrative records replaces ongoing 
contact with sample members, it is a less expensive way to 
collect follow-up data and results in fewer missing 
observations in the later follow-up periods. Administrative 
records also do not depend on the ability of individuals to 
recall precise but important information, such as dates, 
earnings, or the length of enrollment in program activities. 
However, administrative records are limited in the types* of 
outcomes that they measure. Issues of quality and 
completeness will be addressed within the discussion of each 
source. 

7. Calendar quarters are three-month groups beginning with 
January of each year. Quarter one is January, February, and 
March; quarter two is April, May, and June; que :ter three is 
July, August, and S^otember ; and quarter four is October, 
November, and December. 

8. First, employment data reported by the state UI system were 
compared with self-reported employment prior to random assign- 
ment from the CIS for sample members randomly assigned from 
April to June 1986. They were the only sample members who had 
UI data available for the i Lor year. About 10 percent of the 
sample members who reported having earnings in the year rior 
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to randcm assignment did not have Ul-reported earnings during 
this same time. This figure was comparable to the percent- 
ages calculated f rem the same comparison in other states in 
MDRC s Demonstration of State Work/Welfare Initiatives. 
Second, job placement data from the ESARS tracking system was 
compared with Ul-reported employment-, Thirteen percent of 
sample members who were randomly assigned in the last month of 
a calendar quarter and placed within 12 months after random 
assignment did not have earnings reported to the UI system in 
the second through third quarters after random assignment. 

9. Early data were collected from Central Operations for Data 
Exchange and Services (CODES). FAMIS replaced CODES in 
January 1987. 

10. The aggregation of monthly AFDC payments into calendar quarter 
amounts is unlike the measures used in other states, except 
for Maine, in MDRC's Demonstration of State Wo ./Welfare 
Initiatives. In other studies, the AFDC monthly grants were 
sunmed into three-month totals st^rtirg with the month of 
randan assignment. 

11. Automated payment systems are not generally intended to record 
all payments actually made to welfare recipients. There were 
occasions when checks were hand-written to clients. it was 
therefore necessary to determine whether the automated 
research data were sufficiently complete to estimate program 
impacts. Quality checking revealed a high rate of accuracy. 
The county-specific case number system, however, caused some 
people to be lost in the system when they moved. 

The automated data received by MDRC for 172 cases were compar- 
ed with the casefiles for these cases. A total of 4,104 
months of data were checked. In 94.1 percent of these months 
of data, the payment on the MDRC analysis file matched the 
caseflle records. 

12. Telephone calls to WIN staff have confirmed that these data 
represent actual participation in activities, not assignment. 

13. Community college records were not available, but JTPA admin- 
isters many community college activities and records them in 
its tracking system. 
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CHAPTER III 



1. Data from ESARS and CIS. 

2. Data from WIN Grant Diversion On Board Summary Reports; WIN 
Grant Diversion Monthly Report (June 1987 ) ; ES/WIN Grant 
Diversion Monthly Reports (February 1987 to June 1988). The 
nunber of OJT jobs reported in the chapter is for members of 
the research sample. However, between July 1986 and June 
1987, ^24 individuals not in the research were employed in OJT 
jobs. These include 28 experimental s randomly assigned 
between July and September 1986, who were excluded from the 
research because of lack of follow-up, and 196 individuals who 
enrolled in the program after September 30, 1986, the end of 
random assignment. (New Jersey does not record the number of 
enrollees who did not find an OJT job.) In the 12 months 
following the wnd of the demonstration (June 1987 ), 191 new 
OJT jobs were created. Fifty-five welfare recipients who 
enrolled in the program during its pilot phase in the spring 
and sunaer of 1984 also worked in OJT jobs. These too are not 
included in the analysis. 

3. Data on the average starting wage, the percentage of experi- 
mentals who completed their trial employment, and the percent- 
age of experiraentals who were retained as unsubsidized 
employees were obtained from WIN Grant Diversion Monthly 
Report (June 1987) and include the 28 OJT employees randomly 
assigned between July and September 1986 who are not included 
in the research. 

4. The wait was probably longer. For about a third of the 
experimental group, the first day of an OJT job fell within a 
week of random assignment. In some cases it appears that job 
developers called in the client's name for random assignment 
only after finding a likely OJT position for her. 

5. The average length of stay in an OJT job uses the start and 
stop dates recorded in WIN Grant Diversion On Board Summary 
Reports. The measure includes OJT jobs that were terminated 
by enrollees or their employers prior to the end of the OJT 
contract period. The average duration of OJT contracts was 
about four weeks longer, according to a New Jersey DOL memo- 
randum dated August 14, 1987. 

6. From WIK Grant Diversion Monthly Report (June 1987) and 
planning documents from New Jersey DHS and DOL made available 
to MDRC. 



ERLC 



-178- 

21$ 



7. Ibid, 



8, Fran New Jersey DOL, Welfare/WIN Grant Diversion Financial 
Reports (October 1985-September 1986); Employment Security 
Division, Status of Obligation Authority, WIN Demonstration 
Reports and WIN Grant Diversion Reports (September 1986); and 
planning docunents for the demonstration made available to 
MDRC. 

9. A job developer in a second of these four counties stated that 
she spent about 10 percent of her time performing similar 
duties. 

10. The seventh job developer stated that she spent about 85 
percent of her time on the project. An eighth -*ob developer 
simply answered "no" when asked if he worked full-time on the 
project. In Mains, CJT job developers also functioned as job 
placement specialists for the JTPA system. 

11. By contrast, in Maine's TOPS program, most enrollees carried 
out their own job search. 

12. In two counties, job developers stated that there was no 
typical size for an CJT employer. 

13. A more complex situation is captured by the difference in 
placement rates for WIN volunteers and mandatories. Among the 
early sample, 50.5 percent of WIN volunteers *ere placed in 
CJT positions, compared to 38.6 percent of the WIN mandatory 
group. Here too, the difference in placement rates grows 
smaller when the full sample is considered, indicating that 
job developers found ojTs for a higher percentage of the WIN 
mandatory group randomly assigned after October 1985. WIN 
volunteers tended to be younger and better educated than WIN 
mandatories — advantages in the labor market. However, 
nearly all nonmandator i*s had children under six years old who 
needed care and supervision while their mothers worked. 

14. However, fewer than ten AFDC-Us h- /e been employed in OJT jobs 
in the year and a half since they became eligible for OJT 
employment, according to Sally Hall, who, until recently, 
.served as the New Jersey WIN Coordinator. 

15. In Maine's TOPS demonstration, members of the control group 
were also highly served, altnough participation rates for 
controls were sanewhat lower than in New Jersey. In Maine, 
OJT employment also represented only one option among an array 
of WIN services. 
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CHAPTER IV 



1. See also the regression results in Appendix Table D. 1. 

2. Sane might suggest that nonparticipants in on-the-job train- 
ing (who were not placea in subsidized jobs) be excluded from 
impact analyses. However, such exclusions would expose impacts 
to possible selection biases, undermining the control group's 
validity in measuring what would have happened without t*>e 
program. When nonparticipants are excluded f ran the experi- 
mental group, average measured and unmeasured characteristics 
of experimentals may no longer be the same as average control 
group characteristics. See Cave, 1968. 

3. The information in the text applies to the April 1985 - June 
1986 in-program sample of 1,604, but figures are quite similar 
for other samples. Of the 207 members of the October 1984 - 
September 1985 early sample who were placed in subsidized 
jobs, 91.3 percent were finished with their contracts by 
quarter four. 

4. Were it plausible to assume that the impact of assignment to 
on-the-job training is not negative but rather zero for those 
not placed in subsidized jobs, the impact of actual placement 
could be inferred fairly easily fran the impact of assignment. 
See Appendix E, Auspos et al. , 1988, and Cave, 1988. 

5. In the technical literature, the method used to calculate each 
impact and average outcome reported in this chapter is known 
as one-way linear completely randomized analysis of covari- 
ance. Each impact is the difference between two regression- 
adjusted means, one for experimentals and one for controls. 
Appendix Table D. 2 and its accompanying notes provide more 
details. 

6. That is, if the effect of the program on its target population 
really were zero, a difference as large as that observed in 
this sample would occur by chance less than 10 percent of the 
time in repeated random samples of the same size. Thus, a 
statistically significant impact leads to generalizations 
beyond the particular sample drawn for the evaluation to 
inferences about the effect of the program on its target 
population. An impact is more likely to be statistically 
significant the larger the true program effect, the smaller 
the variance of the outcome, the larger the sample size, the 
larger the R-square of the impact equation, the more even the 
sample split between experimentals and controls, the smaller 
the covariate differences between experimentals and controls, 
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and the larger the statistical significance level. See Cave, 
1987. 

It should be r.ct*d that, as explained in Chapter II, the first 
quarter is the calendar quarter in which random assignment 
took place and thus often includes up to three months prior to 
a sample member being randomly assigned. Because of this data 
limitation, first quarter outcomes cannot entirely be attri- 
buted to the period after randan assignment. However, 
perfectly successful random assignment would make all of the 
difference in first quarter average outcomes between experi- 
ment als and controls attributable to post-assignment program 
effects. 

Appendix Table D. 3 gives estimates of the number and fraction 
of the 814 in-program sample experimental active in on-the- 
job-training contracts cumulatively and during each quarter. 
While 45.3 percent were active at some time, the largest 
fractions ever active in individual quarters were 33.8 percent 
and 28.1 percent during quarters one and two, respectively. 
Thus, the peak quarters for employment impacts were 
synchronized with the peak quarters for on-the-job-training 
activity. 

Appendix Table D.4 shows that a much higher proportion of 
experimental than controls first became employed in quarter 
one; more controls than experimental got their first jobs in 
later quarters. Since experiment als had higher employment 
rates than controls in the later quarters, they must have kept 
the ^obs they obtained earlier or gotten other jobs. 

Appendix Table D. 5 gives adjusted mean earnings among experi- 
mental and controls vuio were employed in each period. As 
explained in Appendix D of Auspos et al. , 1988, differences in 
these adjusted means are not quite the same as impacts 
because, to the extent the program was effective, employed 
experimentals may differ in pre-assignment characteristics 
from employed controls. However, a pattern of differences 
growing stronger over time seems evident. 

A cohort analysis showed that this finding apparently resulted 
frcm weaker impacts for those assigned during October 1984 
through December 1984. Since the short-run sample excludes 
this group with weaker impacts, full-sample impacts for the 
first- year would probably have been a bit weaker than the 
results for the short-run sample. 
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For additional information on the use of these procedures in 
MDRC's evaluation of a job search and work experience program 
in California, see Long and Knox, 1985. Details on the data 
and methodology underlying all estimates and all projections 
in this chapter are available from the authors. 

The term "taxpayers" refers to everyone in society except 
members of the welfare sample included in this study. 
However, it is important to note that all sample members are 
taxpayers in the literal sense that they pay sales and excise 
taxes on their purchases; most also pay income and social 
security taxes at some point. 

Benefits are calculated as regression-adjusted differences, 
controlling for a set of demographic characteristics that 
could affect a person's chances of future employment 
independently of the effects of program treatments. The 
independent variables used in the benefit equations are the 
same ones used in the impact equations. 

Assuming that the funding for the program remains the same, 
larger enrollment in an OJT program would spread costs over a 
larger group, resulting in smaller per-capita costs. However, 
the percentage of enrollees employed in CJT jobs may drop 
because staff may not have adequate time and resources to work 
with the larger group of enrollees. One result could be 
increased per-capita use of alternative WIN and JTPA services 
among those waiting to be placed in OJT jobs. Another result 
may be lower earnings gains and welfare savings. 

This was done to avoid including earnings and AFDC payments 
that occurred prior to random assignment and because sample 
members randomly assigned prior to April 1985 have no data for 
the first quarter. Since the program produced a first quarter 
$120 earnings gain for the short-term impact sample, these 
estimates fall a lit*- 1 * below what experimentals actually 
gained. A second difference is that the benefit-cost analysis 
expresses all values in 1986 dollars. The impact analysis, on 
the other hand, uses current values. 

The benefit analysis imputes values for individuals who lack 
earnings data. Sample members randomly assigned between 
October and December 1984 lack earnings data for the second 
quarter following randcm assignment. Each experimental in 
this group was credited with $459.43 in earnings for quarter 
two and each control was credited with $438.50. These values 
equal one-half of the adjusted means for quarter three for 
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experiraentals and controls in the early sample expressed in 
1986 values. In addition, 13 out of the 1,943 individuals in 
the full research sample did not have earnings data for a 
quarter in which earnings should have been available. Each 
individual in this group received the value of earnings for 
the previous quarter. 

6. The value of OJT earnings is estimated at twice the average 
wage subsidy per experimental, as the OJT program subsidized 
50 percent of earnings. See Section IV. A. 1 for an explanation 
of how the average subsidy was estimated. This calculation 
overestimates the effect of OJT employment because it includes 
QJT earnings from the first quarter after randcm assignment, 

7. The fringe benefit rate was based on a national survey of 
firms, reported in U.S. Chamber oi Commerce, 1987. 

8. See Auspos et al. , 1988. 

9. See Kemper and Long, 1981; and Long and Knox, 1985. 

10. The val'ie of output from work experience jobs is estimated by 
determining the compensation that employers would have had to 
pay for other workers to provide the same services. However, 
lack of data on New Jersey work experience jobs and budgetary 
constraints prevented an estimate of this value. As a 
substitute, the analysis estimated the average value of output 
per day (in 19 86 dollars) for work experience employees in 
other work/welfare demonstrations studied by MDRC that took 
place in urban settings: Chicago, San Diego, Baltimore, and 
New York City. (The average value was about $42, including the 
value of fringe benefits and the the relative productivity of 
work experience employees compared to that of regular workers 
in comparable jobs. ) MDRC was able to estimate the average 
number of days in which members of the research sample worked 
in work experience jobs (22.7), based on TRJE records for a 
subsampl e of 42 work exper ience employees. Mul 'c iply i ng 
average days worked by average value of output per day yields 
an estimate of the average value of output per work experience 
participant of $994. Multiplied by the proportion of experi- 
raentals and controls who participated in work experience at 
any time during the follow-up ( . 073 and . 082 respectively), 
the experimental and control averages were $72.57 and $81.52 
and the diffcience was $8.95. 

11. For state and federal income taxes, MDRC estimated the number 
of exemptions as one plus the nimber of children under 19 
reported on the CIS. If the sample member reported that she 
was married and living with her spouse, she received an 
additional exemption. Estimates of New Jersey state income 
taxes assume that each sample member was * full-time resident 
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and eligible for income deductions and tax credits for rent- 
ers. Social Security taxes were estimated as 7.15 percent of 
earnings, the 1986 rate. UI Compensation Taxes were estimated 
at 1.4 percent of earnings, based on survey data published in 
U. S. Chamber of Commerce, 1987. Sales and excise taxes were 
estimated as 2 percent of combined AFDC and earnings income. 
This rate accounts for New Jersey's 6 percent sales tax and 
federal data which suggest that one-third of the expenditures 
of urban lower-income families is spent on taxable items. 

12. Grant diversion calculations were performed from the third 
month following the start of OJT employment to tha second 
month following the end of the OJT. 

13. The per-recipient cost was based on data on Medicaid expendi- 
tures for AFDC-C families provided by the New Jersey DHS, 
Division of Medical Assistance and Health Services, Bureau of 
Health Statistics and Economics, and published data on average 
nunber of AFDC recipients from New Jersey DHS, 1987. 

14. Food Stamp computations use .1986 payment regulations and data 
on Food Stamp receipt published in New Jersey DHS, 1987. 
According to New Jersey DHS, 92.5 percent of AFDC-C families 
received Food Stamps during FY 1986. Estimated quarterly 
values of Food Starips were therefore multiplied by . 925. 
(This differs from previous MDRC estimates which use a factor 
of .8, based on a national survey. ) Food Stamp regulations 
allow a standard deduction of $98 per mon*h and an additional 
deduction for out-of-pocket, work-related expenses such as 
childcare. To estimate the value of childcare expenses, MDRC 
calculated the average monthly childcare deduction claimed by 
members of a randomly selected subsample of 60 experimentals 
and controls from Monmouth, Hudson, and Mercer Counties during 
calculation of their monthly AFDC grants. Its value was $51 
per quarter. Food Stamp regulations also permit a deduction 
for medical expenses. To estimate the monthly deduction, MDRC 
took the monthly average of Medicaid paid out to the sample 
member ($74 times the number of dependents) and subtracted $35 
(as mandated by Food Stamp regulations). A sample member was 
only credited with thib cost if she was not eligible for 
Medicaid during the month in nnestion. New Jersey allows an 
additional $25 deduction < jalnst the value of AFDC benefits 
for energy costs. Althou<ji. Foo Stamp regulations allow for 
an additional deduction for Tctc . Shelter Costs, MDRC had no 
data with which to estimate this cost. Therefore, this 
deduction was left out of the calculations. Also left out was 
the addition to income from UI benefits. 

15 Estimates of New Jersey AFDC and Food Stamp administrative 
costs were derived from "Sunraary of Financial Transactions, FY 
1985-1986," New Jersey DHS, 1987. Estimates of state 
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expenditures for Medicaid administration were derived from 
Table 63, "Medicaid Costs for State Acta i n ins trat ion and Train- 
ing for FY 1986," U.S. DHHS, 1987. Federal administrative 
costs for each of these transfer programs were based on 
Executive Office of the President, Office of Management and 
Budget, 1986. To estimate the experiraental-contrcl difference 
in AFDC administration, MDRC calculated the cost of administer- 
ing one case in New Jersey for one month: $62.32 in 1986 
dollars. To estimate the monthly cost of administering 
Medicaid in New Jersey, MDRC assumed that the same percentage 
of Medicaid administrative expenditures was devoted to AFDC-C 
families as Medicaid payments (25.6 percent). The mcntnly cost 
was $4.50 multiplied by the nunber of case members. The bene- 
fit estimates for AFDC and Medicaid adninistration presented 
in Table 5.2 are the experimental-control differences in the 
number of months of eligibility for these programs multiplied 
by the monthly cost of program administration. The cost of 
Food Stamp adninistration was estimated in a similar manner as 
the cost of AFDC administration, except that it was based on a 
quarterly adninistra tive cost ($88.69) rather than a monthly 
cost. Added to each state transfer payment administrative 
cost was a federal cost, which, due to data limitations, was 
estimated as a proportion of the experimental-control differ- 
ence of each transfer payment. These cost factors were: .004 
for AFDC admininstration; .005 for Medicaid administration; 
and .0127 for Food Stamp adninistration. 

Because of retrospective budgeting, grants are calculated e.nd 
funds transferred to the wage subsidy pools for two months 
after the end of the contract period. To account for this 
cost, the analysis credited each OJT employee with eligibility 
for AFDC for these two months. This procedure did not affect 
the estimation of AFDC payments. 

16. Projecting benefits to the end of five years permits 
comparisons with other demonstrations evaluated by MDRC. 

17. See Masters, 1981; and Friedlander, 1987. 

18. A generally accepted range of discount rates is from 3 to 10 
percent. (See Kemper et al. , 1981.) Because the time period 
over which impacts are projected is relatively short, the 
benefit-cost results would not be substantially affected by 
the choice of a higher of lower discount rate. 

19. Evidence for this assertion comes from a set of regression 
equations using earnings as the dependent variable, dummy 
variables for OJT employment and for the 59 percent of 
expe\ imentu 1 z who were not employed in an OJT job, and the 
usual set of covariates. OJT employees showed earnings gains 
of $905 during the ccmraon period but the remaining 
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experimentals showed a net loss of -$168. For the entire 
observation period, OJT employees showed a $2200 gain while 
other experimentals broke even. It should be remembered that 
OJT employees may differ in background, motivation, and other 
unmeasured characteristics from other experimentals and from 
the control group. 

20. As discussed belcw, the value of WIN support service payments 
enters into the overall estimate of net gains for experi- 
mentals. 

21. The projection of federal income taxes uses 1988 tax rates. 

22. Theoretically, failure to adjust for county differences in the 
cost of providing WIN services or SDA differences in the cost 
of delivering JTPA services could bias the cost estimates (so 
could failure to account for geographic differences in avail- 
ability of services or local variations in client-caseworker 
ratios or client-staff relationships). However, regression- 
adjusted costs are difficult to use when planning services. 
To test the sensitivity of cost estimates to regression 
adjustment, MDRC rap a series of OLS regression equations, 
using service costs as the dependent variables and controlling 
fc* the ~arae factors as in the benefit estimates. This 
procedure changed the total experimental-control difference in 
service costs by less than $5. Therefore, unadjusted costs 
are presented here. 

23. In calculating unit costs, both research sample member 0 and 
nonmembers who were participants in a given activity were 
included, 

24. FY 1986 represents a period when the OJT program was running 
at a "steady state," i.e., when one-time start-up costs had 
already been paid. The fiscal year for New Jersey JTPA and 
New Jersey DHS expenditures runs from July to June, while the 
fiscal for WIN expenditures runs from October to September, 
Unit costs in current dollars were transformed to 1986 dollars 
to make them equivalent. 

25. ESARS data suggest that few sample members began activities 
during the second year after randan assignment. Theiefore, 
cost estimates probably fall below actual costs by very 
little. 

26. The sources are: New Jersey DOL, Welfare/WIN Grant Diversion 
Financial Reports (June 1984-March 1987); New Jersey WIN Grant 
Diversion Project On Board Summary Reports; New Jersey WIN 
Grant Diversion Project Monthly Reports; and New Jersey Grant 
Diversion Project, IVA Project, Monthly Reports. 



-186- 



o 227 

ERIC 



27. The value of wage subsidies in current dollars was $444,367. 
The 562 CUT placements were funded in part with federal OFA 
demonstration money. The additional placements during January 
to June 1987 financed with Title IV-A money are not included. 

28. The sources are: new Jersey DOL, Employment Security Division, 
Status of Obligation Authority, WIN Demonstration Reports; WIN 
Grant Diversion Reports; Time Distribution Report by District; 
N w Jersey WIN Grant Diversion Project Monthly Reports; and 
expenditure data supplied by New Jersey DHS. Stitus of 
Obligation Reports display expenditures for vacation time and 
fringe benefits. The Time Distribution Reports do not. In 
counties where job developers were paid cut of the regular WIN 
budget, expenditures for staff time devoted to the OJT program 
were taken fran the Time Distribution Reports and marked up 
for the value of vacation time and fringe benefits, based on 
the proportion of expenditures for these items in the general 
WIN staff budget for the county. Cost estimates are also 
marked up for nonstaff costs. The mark-up rate is .1659 and 
is derived by dividing total state-wide nonstaff costs for New 
Jersey WIN by total staff costs. The general WIN mark-up rate 
was used because almost all nonstaff costs for the New Jersey 
OJT Program were paid out of general WIN funds. The cost of 
ES/WIN central administration and of New Jersey DHS central 
administration of the OJT program are included in the cost 
estimate. 

29. The sources are Status of Obligation, WIN Demonstration 
Reports; Time Distribution Reports; New Jersey DOL, ES/WIN 
LMMR Statewide Cumulative Counts and Time Distribution Manual; 
and ESARS. Staff costs for individual activities are marked up 
for vacation time, fringes, and nonstaf costs as described 
above. 

30. According to the New Jersey DOL, Time Distribution Manual, 
expenditures for individual job search include staff time 
supervising individual job search activities, job development 
contacts (for unsubsidized employment), and referrals to 
unsubsidized employment. Therefore, sample members with any 
of these activities recorded on ESARS were credited with the 
unit cost of individual job search. However, sample members 
were only credited with one instance even if participation 
records for more than one of these activities were recorded on 
ESARS. 

31. The sources for estimating costs of administration and 
enforcement are the same as listed in footnote 29 plus New 
Jersey DHS, WIN/BEP Expenditures, FFY 1986, Schedules 1 and 2. 
As described in Chapter III, New Jersey DHS, Bureau of 
Employment Programs staff perform a variety of functions 
within the WIN system. However, published expenditure data 
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were not disaggregated into specific functions. Therefore, 
all expenditures were included in administration and enforce- 
ment. Also included in this estimate are costs of ES/WIN and 
DHS, BEP central administration. 

32. There was no formal exit from the OJT program, other than 
deregistration from WIN. It is therefore difficult to 
demarcate when OJT administration costs end and regular WIN 
administration costs begin. The estimation procedures for 
each Jf these costs attempt to divide them in a reasonable 
way. 

33. These deductions probably result in smaller experimental- 
control differences in welfare savings during the observation 
period. 

As discussed in Chapter III, OJT employees were eligible for 
support services during the first year of the program. MDRC 
did not attempt to measure receipt of support payments by OJT 
employees during this time; however, discussions with program 
administrators and examination of automated records of 
childcare payments for that period suggest that few OJT 
employees received support payments. 

34. Sources used were New Jersey, DOL, Division of Employment and 
Training, JTPA Expenditures By Title, Program Yeai 1985 and 
Enrollments, PY 1985. 

35. The total cost of serving experimentals in Maine's TOPS 
program averaged $2,761. see Auspos et al, 1988. 

36. The government budget receives more than the value of payroll 
taxes displayed in Table 5.3 because both employers and 
employees pay social security taxes equal to 7.15 percent of 
earnings. The additional amount represents UI Compensation 
taxes incurred by employers. 

37. In this accounting perspective, the government receives the 
full benefit of welfare savings (i.e., the diverted grant is 
not subtracted). The loss represented by diverted grants is 
covered in the cost of employer subsidies. 

38. According to WIN Grant Diversion Project Monthly Report (June 
1987) and Grant Diversion Project, IVA Project Monthly Report 
(June 1988), between October 1986 and June 1988, the progran 
placed 419 enrollees who were not part of the demonstration. 
Thus the program is averaging about 20 placements per month or 
240 per ytar. 
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